Nov 08 20:01:45 user nova-compute[74638]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74638) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74638) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74638) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 20:01:45 user nova-compute[74638]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:01:45 user nova-compute[74638]: INFO nova.virt.driver [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 20:01:45 user nova-compute[74638]: INFO nova.compute.provider_config [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] Acquiring lock "singleton_lock" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] Acquired lock "singleton_lock" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] Releasing lock "singleton_lock" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] Full set of CONF: {{(pid=74638) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ******************************************************************************** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] Configuration options gathered from: {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ================================================================================ {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] allow_resize_to_same_host      = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] arq_binding_timeout            = 300 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] backdoor_port                  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] backdoor_socket                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] block_device_allocate_retries  = 300 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] block_device_allocate_retries_interval = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cert                           = self.pem {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute_monitors               = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] config_dir                     = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] config_drive_format            = iso9660 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] config_source                  = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] console_host                   = user {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] control_exchange               = nova {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cpu_allocation_ratio           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] daemon                         = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] debug                          = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] default_access_ip_network_name = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] default_availability_zone      = nova {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] default_ephemeral_format       = ext4 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] default_green_pool_size        = 1000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] default_schedule_zone          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] disk_allocation_ratio          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] enable_new_services            = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] enabled_ssl_apis               = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] flat_injected                  = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] force_config_drive             = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] force_raw_images               = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] graceful_shutdown_timeout      = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] heal_instance_info_cache_interval = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] host                           = user {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] instance_build_timeout         = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] instance_delete_interval       = 300 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] instance_name_template         = instance-%08x {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] instance_usage_audit           = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] instance_usage_audit_period    = month {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] internal_service_availability_zone = internal {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] key                            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] live_migration_retry_count     = 30 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] log_config_append              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] log_dir                        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] log_file                       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] log_options                    = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] log_rotate_interval            = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] log_rotate_interval_type       = days {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] log_rotation_type              = none {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] long_rpc_timeout               = 1800 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] max_concurrent_builds          = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] max_concurrent_live_migrations = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] max_concurrent_snapshots       = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] max_local_block_devices        = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] max_logfile_count              = 30 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] max_logfile_size_mb            = 200 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] maximum_instance_delete_attempts = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] metadata_listen                = 0.0.0.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] metadata_listen_port           = 8775 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] metadata_workers               = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] migrate_max_retries            = -1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] mkisofs_cmd                    = genisoimage {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] my_ip                          = 10.0.0.210 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] network_allocate_retries       = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] osapi_compute_listen_port      = 8774 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] osapi_compute_unique_server_name_scope =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] osapi_compute_workers          = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] password_length                = 12 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] periodic_enable                = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] periodic_fuzzy_delay           = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] pointer_model                  = ps2mouse {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] preallocate_images             = none {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] publish_errors                 = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] pybasedir                      = /opt/stack/nova {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ram_allocation_ratio           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] rate_limit_burst               = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] rate_limit_except_level        = CRITICAL {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] rate_limit_interval            = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] reboot_timeout                 = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] reclaim_instance_interval      = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] record                         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] reimage_timeout_per_gb         = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] report_interval                = 120 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] rescue_timeout                 = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] reserved_host_cpus             = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] reserved_host_disk_mb          = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] reserved_host_memory_mb        = 512 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] reserved_huge_pages            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] resize_confirm_window          = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] resize_fs_using_block_device   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] resume_guests_state_on_host_boot = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] rpc_response_timeout           = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] run_external_periodic_tasks    = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] running_deleted_instance_action = reap {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] running_deleted_instance_timeout = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler_instance_sync_interval = 120 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_down_time              = 720 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] servicegroup_driver            = db {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] shelved_offload_time           = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] shelved_poll_interval          = 3600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] shutdown_timeout               = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] source_is_ipv6                 = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ssl_only                       = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] state_path                     = /opt/stack/data/nova {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] sync_power_state_interval      = 600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] sync_power_state_pool_size     = 1000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] syslog_log_facility            = LOG_USER {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] tempdir                        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] timeout_nbd                    = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] transport_url                  = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] update_resources_interval      = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] use_cow_images                 = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] use_eventlog                   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] use_journal                    = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] use_json                       = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] use_rootwrap_daemon            = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] use_stderr                     = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] use_syslog                     = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vcpu_pin_set                   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plugging_is_fatal          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plugging_timeout           = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] virt_mkfs                      = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] volume_usage_poll_interval     = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] watch_log_file                 = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] web                            = /usr/share/spice-html5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_concurrency.disable_process_locking = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.auth_strategy              = keystone {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.compute_link_prefix        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.dhcp_domain                = novalocal {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.enable_instance_password   = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.glance_link_prefix         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.instance_list_per_project_cells = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.list_records_by_skipping_down_cells = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.local_metadata_per_cell    = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.max_limit                  = 1000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.metadata_cache_expiration  = 15 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.neutron_default_tenant_id  = default {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.use_forwarded_for          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.use_neutron_default_nets   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.vendordata_dynamic_targets = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.vendordata_jsonfile_path   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.backend_argument         = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.config_prefix            = cache.oslo {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.dead_timeout             = 60.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.debug_cache_backend      = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.enable_retry_client      = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.enable_socket_keepalive  = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.enabled                  = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.expiration_time          = 600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.hashclient_retry_attempts = 2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_dead_retry      = 300 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_password        =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_sasl_enabled    = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.memcache_username        =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.proxies                  = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.retry_attempts           = 2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.retry_delay              = 0.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.socket_keepalive_count   = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.socket_keepalive_idle    = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.socket_keepalive_interval = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.tls_allowed_ciphers      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.tls_cafile               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.tls_certfile             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.tls_enabled              = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cache.tls_keyfile              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.auth_section            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.auth_type               = password {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.cafile                  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.certfile                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.collect_timing          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.cross_az_attach         = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.debug                   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.endpoint_template       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.http_retries            = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.insecure                = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.keyfile                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.os_region_name          = RegionOne {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.split_loggers           = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cinder.timeout                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.cpu_dedicated_set      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.cpu_shared_set         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.image_type_exclude_list = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.resource_provider_association_refresh = 300 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.shutdown_retry_interval = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] conductor.workers              = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] console.allowed_origins        = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] console.ssl_ciphers            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] console.ssl_minimum_version    = default {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] consoleauth.token_ttl          = 600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.cafile                  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.certfile                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.collect_timing          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.connect_retries         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.connect_retry_delay     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.endpoint_override       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.insecure                = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.keyfile                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.max_version             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.min_version             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.region_name             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.service_name            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.service_type            = accelerator {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.split_loggers           = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.status_code_retries     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.status_code_retry_delay = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.timeout                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] cyborg.version                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.backend               = sqlalchemy {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.connection            = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.connection_debug      = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.connection_parameters =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.connection_recycle_time = 3600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.connection_trace      = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.db_inc_retry_interval = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.db_max_retries        = 20 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.db_max_retry_interval = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.db_retry_interval     = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.max_overflow          = 50 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.max_pool_size         = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.max_retries           = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.mysql_wsrep_sync_wait = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.pool_timeout          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.retry_interval        = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.slave_connection      = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] database.sqlite_synchronous    = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.backend           = sqlalchemy {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.connection        = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.connection_debug  = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.connection_parameters =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.connection_recycle_time = 3600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.connection_trace  = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.db_inc_retry_interval = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.db_max_retries    = 20 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.db_max_retry_interval = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.db_retry_interval = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.max_overflow      = 50 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.max_pool_size     = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.max_retries       = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.pool_timeout      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.retry_interval    = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.slave_connection  = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] api_database.sqlite_synchronous = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] devices.enabled_mdev_types     = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ephemeral_storage_encryption.enabled = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.api_servers             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.cafile                  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.certfile                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.collect_timing          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.connect_retries         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.connect_retry_delay     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.debug                   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.default_trusted_certificate_ids = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.enable_certificate_validation = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.enable_rbd_download     = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.endpoint_override       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.insecure                = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.keyfile                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.max_version             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.min_version             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.num_retries             = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.rbd_ceph_conf           =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.rbd_connect_timeout     = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.rbd_pool                =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.rbd_user                =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.region_name             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.service_name            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.service_type            = image {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.split_loggers           = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.status_code_retries     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.status_code_retry_delay = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.timeout                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.verify_glance_signatures = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] glance.version                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] guestfs.debug                  = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.config_drive_cdrom      = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.config_drive_inject_password = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.enable_remotefx         = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.instances_path_share    =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.limit_cpu_features      = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.use_multipath_io        = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.vswitch_name            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] mks.enabled                    = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] image_cache.manager_interval   = 2400 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] image_cache.precache_concurrency = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] image_cache.remove_unused_base_images = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] image_cache.subdirectory_name  = _base {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.api_max_retries         = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.api_retry_interval      = 2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.auth_section            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.auth_type               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.cafile                  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.certfile                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.collect_timing          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.conductor_group         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.connect_retries         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.connect_retry_delay     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.endpoint_override       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.insecure                = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.keyfile                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.max_version             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.min_version             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.peer_list               = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.region_name             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.serial_console_state_timeout = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.service_name            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.service_type            = baremetal {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.split_loggers           = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.status_code_retries     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.status_code_retry_delay = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.timeout                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ironic.version                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] key_manager.fixed_key          = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.barbican_api_version  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.barbican_endpoint     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.barbican_endpoint_type = public {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.barbican_region_name  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.cafile                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.certfile              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.collect_timing        = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.insecure              = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.keyfile               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.number_of_retries     = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.retry_delay           = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.send_service_user_token = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.split_loggers         = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.timeout               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.verify_ssl            = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican.verify_ssl_path       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.auth_section = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.auth_type = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.cafile   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.certfile = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.collect_timing = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.insecure = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.keyfile  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.split_loggers = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] barbican_service_user.timeout  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.approle_role_id          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.approle_secret_id        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.cafile                   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.certfile                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.collect_timing           = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.insecure                 = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.keyfile                  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.kv_mountpoint            = secret {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.kv_path                  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.kv_version               = 2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.namespace                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.root_token_id            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.split_loggers            = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.ssl_ca_crt_file          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.timeout                  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.use_ssl                  = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.auth_section          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.auth_type             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.cafile                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.certfile              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.collect_timing        = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.connect_retries       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.connect_retry_delay   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.endpoint_override     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.insecure              = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.keyfile               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.max_version           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.min_version           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.region_name           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.service_name          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.service_type          = identity {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.split_loggers         = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.status_code_retries   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.status_code_retry_delay = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.timeout               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] keystone.version               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.connection_uri         =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.cpu_mode               = custom {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: WARNING oslo_config.cfg [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.cpu_power_governor_high = performance {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.cpu_power_management   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.device_detach_attempts = 8 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.device_detach_timeout  = 20 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.disk_cachemodes        = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.disk_prefix            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.enabled_perf_events    = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.file_backed_memory     = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.gid_maps               = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.hw_disk_discard        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.hw_machine_type        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.images_rbd_pool        = rbd {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.images_type            = default {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.images_volume_group    = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.inject_key             = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.inject_partition       = -2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.inject_password        = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.iscsi_iface            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.iser_use_multipath     = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_downtime = 500 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_inbound_addr = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_scheme  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_timeout_action = abort {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_tunnelled = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: WARNING oslo_config.cfg [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 20:01:45 user nova-compute[74638]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 20:01:45 user nova-compute[74638]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 20:01:45 user nova-compute[74638]: and ``live_migration_inbound_addr`` respectively.
Nov 08 20:01:45 user nova-compute[74638]: ).  Its value may be silently ignored in the future.
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.live_migration_with_native_tls = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.max_queues             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.nfs_mount_options      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.num_pcie_ports         = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.pmem_namespaces        = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.quobyte_client_cfg     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:45 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rbd_secret_uuid        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rbd_user               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rescue_image_id        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rescue_kernel_id       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.rx_queue_size          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.smbfs_mount_options    =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.snapshot_compression   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.snapshot_image_format  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.sparse_logical_volumes = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.swtpm_enabled          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.swtpm_group            = tss {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.swtpm_user             = tss {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.sysinfo_serial         = unique {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.tb_cache_size          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.tx_queue_size          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.uid_maps               = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.use_virtio_for_bridges = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.virt_type              = kvm {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.volume_clear           = zero {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.volume_clear_size      = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.volume_use_multipath   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.vzstorage_cache_path   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.auth_section           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.auth_type              = password {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.cafile                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.certfile               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.collect_timing         = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.connect_retries        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.connect_retry_delay    = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.default_floating_pool  = public {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.endpoint_override      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.extension_sync_interval = 600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.http_retries           = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.insecure               = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.keyfile                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.max_version            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.min_version            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.ovs_bridge             = br-int {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.physnets               = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.region_name            = RegionOne {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.service_metadata_proxy = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.service_name           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.service_type           = network {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.split_loggers          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.status_code_retries    = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.status_code_retry_delay = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.timeout                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] neutron.version                = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] notifications.bdms_in_notifications = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] notifications.default_level    = INFO {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] notifications.notification_format = unversioned {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] notifications.notify_on_state_change = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] pci.alias                      = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] pci.device_spec                = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] pci.report_in_placement        = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.auth_section         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.auth_type            = password {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.cafile               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.certfile             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.collect_timing       = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.connect_retries      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.connect_retry_delay  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.default_domain_id    = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.default_domain_name  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.domain_id            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.domain_name          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.endpoint_override    = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.insecure             = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.keyfile              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.max_version          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.min_version          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.password             = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.project_domain_id    = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.project_domain_name  = Default {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.project_id           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.project_name         = service {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.region_name          = RegionOne {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.service_name         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.service_type         = placement {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.split_loggers        = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.status_code_retries  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.status_code_retry_delay = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.system_scope         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.timeout              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.trust_id             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.user_domain_id       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.user_domain_name     = Default {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.user_id              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.username             = placement {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] placement.version              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.cores                    = 20 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.count_usage_from_placement = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.injected_file_content_bytes = 10240 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.injected_file_path_length = 255 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.injected_files           = 5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.instances                = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.key_pairs                = 100 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.metadata_items           = 128 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.ram                      = 51200 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.recheck_quota            = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.server_group_members     = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] quota.server_groups            = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] rdp.enabled                    = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.image_metadata_prefilter = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.max_attempts         = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.max_placement_results = 1000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] scheduler.workers              = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.host_subset_size = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.isolated_hosts = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.isolated_images = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.pci_in_placement = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.track_instance_changes = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] metrics.required               = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] metrics.weight_multiplier      = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] metrics.weight_setting         = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] serial_console.enabled         = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] serial_console.port_range      = 10000:20000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] serial_console.serialproxy_port = 6083 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.auth_section      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.auth_type         = password {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.cafile            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.certfile          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.collect_timing    = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.insecure          = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.keyfile           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.send_service_user_token = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.split_loggers     = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] service_user.timeout           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.agent_enabled            = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.enabled                  = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.html5proxy_port          = 6082 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.image_compression        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.jpeg_compression         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.playback_compression     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.server_listen            = 127.0.0.1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.streaming_mode           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] spice.zlib_compression         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] upgrade_levels.baseapi         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] upgrade_levels.cert            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] upgrade_levels.compute         = auto {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] upgrade_levels.conductor       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] upgrade_levels.scheduler       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.cafile = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.certfile = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.insecure = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vendordata_dynamic_auth.timeout = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.api_retry_count         = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.ca_file                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.cache_prefix            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.cluster_name            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.connection_pool_size    = 10 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.console_delay_seconds   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.datastore_regex         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.host_ip                 = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.host_password           = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.host_port               = 443 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.host_username           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.insecure                = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.integration_bridge      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.maximum_objects         = 100 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.pbm_default_policy      = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.pbm_enabled             = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.pbm_wsdl_location       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.serial_port_proxy_uri   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.serial_port_service_uri = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.task_poll_interval      = 0.5 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.use_linked_clone        = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.vnc_keymap              = en-us {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.vnc_port                = 5900 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vmware.vnc_port_total          = 10000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.auth_schemes               = ['none'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.enabled                    = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.novncproxy_port            = 6080 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.vencrypt_ca_certs          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.vencrypt_client_cert       = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vnc.vencrypt_client_key        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.disable_rootwrap   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.enable_numa_live_migration = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.libvirt_disable_apic = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.client_socket_timeout     = 900 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.default_pool_size         = 1000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.keep_alive                = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.max_header_line           = 16384 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.ssl_ca_file               = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.ssl_cert_file             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.ssl_key_file              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.tcp_keepidle              = 600 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] zvm.ca_file                    = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] zvm.cloud_connector_url        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] zvm.reachable_timeout          = 300 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.enforce_new_defaults = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.enforce_scope      = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.policy_default_rule = default {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.connection_string     = messaging:// {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.enabled               = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.es_doc_type           = notification {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.es_scroll_size        = 10000 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.es_scroll_time        = 2m {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.filter_error_trace    = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.hmac_keys             = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.sentinel_service_name = mymaster {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.socket_timeout        = 0.1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.trace_requests        = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler.trace_sqlalchemy      = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler_jaeger.process_tags   = {} {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler_jaeger.service_name_prefix = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] profiler_otlp.service_name_prefix = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] remote_debug.host              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] remote_debug.port              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_notifications.retry = -1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.auth_section        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.auth_type           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.cafile              = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.certfile            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.collect_timing      = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.connect_retries     = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.connect_retry_delay = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.endpoint_id         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.endpoint_override   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.insecure            = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.keyfile             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.max_version         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.min_version         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.region_name         = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.service_name        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.service_type        = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.split_loggers       = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.status_code_retries = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.status_code_retry_delay = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.timeout             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.valid_interfaces    = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_limit.version             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_reports.file_event_handler = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] oslo_reports.log_dir           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_ovs_privileged.group  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] vif_plug_ovs_privileged.user   = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_ovs.isolate_vif         = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] os_brick.lock_path             = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] privsep_osbrick.capabilities   = [21] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] privsep_osbrick.group          = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] privsep_osbrick.helper_command = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] privsep_osbrick.user           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] nova_sys_admin.group           = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] nova_sys_admin.helper_command  = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] nova_sys_admin.user            = None {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG oslo_service.service [None req-c17b490b-ba37-4c76-a315-3718fdd3d7e1 None None] ******************************************************************************** {{(pid=74638) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 20:01:46 user nova-compute[74638]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 20:01:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Connecting to libvirt: qemu:///system {{(pid=74638) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe54df72fb0> {{(pid=74638) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 20:01:46 user nova-compute[74638]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 20:01:46 user nova-compute[74638]: WARNING nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 20:01:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe54df72fb0> {{(pid=74638) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Starting native event thread {{(pid=74638) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Starting green dispatch thread {{(pid=74638) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 20:01:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Starting connection event dispatch thread {{(pid=74638) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 20:01:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Connection event '1' reason 'None'
Nov 08 20:01:46 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 20:01:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.mount [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Initialising _HostMountState generation 0 {{(pid=74638) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 20:01:53 user nova-compute[74638]: INFO nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host capabilities <capabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <host>
Nov 08 20:01:53 user nova-compute[74638]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 20:01:53 user nova-compute[74638]:     <cpu>
Nov 08 20:01:53 user nova-compute[74638]:       <arch>x86_64</arch>
Nov 08 20:01:53 user nova-compute[74638]:       <model>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <microcode version='1070'/>
Nov 08 20:01:53 user nova-compute[74638]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 20:01:53 user nova-compute[74638]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='osxsave'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='invtsc'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='rsba'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 20:01:53 user nova-compute[74638]:       <pages unit='KiB' size='4'/>
Nov 08 20:01:53 user nova-compute[74638]:       <pages unit='KiB' size='2048'/>
Nov 08 20:01:53 user nova-compute[74638]:     </cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <power_management>
Nov 08 20:01:53 user nova-compute[74638]:       <suspend_mem/>
Nov 08 20:01:53 user nova-compute[74638]:       <suspend_disk/>
Nov 08 20:01:53 user nova-compute[74638]:       <suspend_hybrid/>
Nov 08 20:01:53 user nova-compute[74638]:     </power_management>
Nov 08 20:01:53 user nova-compute[74638]:     <iommu support='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <migration_features>
Nov 08 20:01:53 user nova-compute[74638]:       <live/>
Nov 08 20:01:53 user nova-compute[74638]:       <uri_transports>
Nov 08 20:01:53 user nova-compute[74638]:         <uri_transport>tcp</uri_transport>
Nov 08 20:01:53 user nova-compute[74638]:         <uri_transport>rdma</uri_transport>
Nov 08 20:01:53 user nova-compute[74638]:       </uri_transports>
Nov 08 20:01:53 user nova-compute[74638]:     </migration_features>
Nov 08 20:01:53 user nova-compute[74638]:     <topology>
Nov 08 20:01:53 user nova-compute[74638]:       <cells num='2'>
Nov 08 20:01:53 user nova-compute[74638]:         <cell id='0'>
Nov 08 20:01:53 user nova-compute[74638]:           <memory unit='KiB'>8189224</memory>
Nov 08 20:01:53 user nova-compute[74638]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 08 20:01:53 user nova-compute[74638]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 20:01:53 user nova-compute[74638]:           <distances>
Nov 08 20:01:53 user nova-compute[74638]:             <sibling id='0' value='10'/>
Nov 08 20:01:53 user nova-compute[74638]:             <sibling id='1' value='20'/>
Nov 08 20:01:53 user nova-compute[74638]:           </distances>
Nov 08 20:01:53 user nova-compute[74638]:           <cpus num='6'>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 20:01:53 user nova-compute[74638]:           </cpus>
Nov 08 20:01:53 user nova-compute[74638]:         </cell>
Nov 08 20:01:53 user nova-compute[74638]:         <cell id='1'>
Nov 08 20:01:53 user nova-compute[74638]:           <memory unit='KiB'>8206460</memory>
Nov 08 20:01:53 user nova-compute[74638]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 08 20:01:53 user nova-compute[74638]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 20:01:53 user nova-compute[74638]:           <distances>
Nov 08 20:01:53 user nova-compute[74638]:             <sibling id='0' value='20'/>
Nov 08 20:01:53 user nova-compute[74638]:             <sibling id='1' value='10'/>
Nov 08 20:01:53 user nova-compute[74638]:           </distances>
Nov 08 20:01:53 user nova-compute[74638]:           <cpus num='6'>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 20:01:53 user nova-compute[74638]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 20:01:53 user nova-compute[74638]:           </cpus>
Nov 08 20:01:53 user nova-compute[74638]:         </cell>
Nov 08 20:01:53 user nova-compute[74638]:       </cells>
Nov 08 20:01:53 user nova-compute[74638]:     </topology>
Nov 08 20:01:53 user nova-compute[74638]:     <cache>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 20:01:53 user nova-compute[74638]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 20:01:53 user nova-compute[74638]:     </cache>
Nov 08 20:01:53 user nova-compute[74638]:     <secmodel>
Nov 08 20:01:53 user nova-compute[74638]:       <model>apparmor</model>
Nov 08 20:01:53 user nova-compute[74638]:       <doi>0</doi>
Nov 08 20:01:53 user nova-compute[74638]:     </secmodel>
Nov 08 20:01:53 user nova-compute[74638]:     <secmodel>
Nov 08 20:01:53 user nova-compute[74638]:       <model>dac</model>
Nov 08 20:01:53 user nova-compute[74638]:       <doi>0</doi>
Nov 08 20:01:53 user nova-compute[74638]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 20:01:53 user nova-compute[74638]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 20:01:53 user nova-compute[74638]:     </secmodel>
Nov 08 20:01:53 user nova-compute[74638]:   </host>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='alpha'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>clipper</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='armv6l'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>spitz</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>nuri</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>kzm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sx1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>z2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>tosa</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>n810</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>n800</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>terrier</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>midway</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>microbit</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>verdex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>highbank</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>akita</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>connex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>collie</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='armv7l'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>spitz</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>nuri</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>kzm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sx1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>z2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>tosa</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>n810</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>n800</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>terrier</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>midway</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>microbit</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>verdex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>highbank</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>akita</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>connex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>collie</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='aarch64'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>spitz</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>nuri</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>kzm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sx1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>z2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>tosa</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>n810</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>n800</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>terrier</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>midway</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>microbit</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>verdex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>highbank</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>akita</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>connex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>collie</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <acpi default='on' toggle='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='cris'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='i686'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>isapc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>microvm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='kvm'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <pae/>
Nov 08 20:01:53 user nova-compute[74638]:       <nonpae/>
Nov 08 20:01:53 user nova-compute[74638]:       <acpi default='on' toggle='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:       <apic default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='m68k'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>an5206</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>q800</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='microblaze'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='microblazeel'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='mips'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='16'>malta</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='mipsel'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='16'>malta</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='mips64'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='16'>malta</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>pica61</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>magnum</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='mips64el'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='16'>malta</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>pica61</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>magnum</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='16'>boston</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='ppc'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mac99</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>40p</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>taihu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='ppc64'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>taihu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>40p</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mac99</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='ppc64le'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>taihu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>40p</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>mac99</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='riscv32'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='8'>spike</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='8'>virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='riscv64'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='8'>spike</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='8'>virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='s390x'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='sh4'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>shix</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>r2d</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='sh4eb'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>shix</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>r2d</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='sparc'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>LX</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='sparc64'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>niagara</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='x86_64'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>64</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='1'>isapc</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>microvm</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='kvm'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <acpi default='on' toggle='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:       <apic default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='xtensa'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>sim</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>kc705</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>ml605</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>lx200</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>lx60</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]:   <guest>
Nov 08 20:01:53 user nova-compute[74638]:     <os_type>hvm</os_type>
Nov 08 20:01:53 user nova-compute[74638]:     <arch name='xtensaeb'>
Nov 08 20:01:53 user nova-compute[74638]:       <wordsize>32</wordsize>
Nov 08 20:01:53 user nova-compute[74638]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='4'>sim</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>kc705</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>ml605</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>virt</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>lx200</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>lx60</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 20:01:53 user nova-compute[74638]:       <domain type='qemu'/>
Nov 08 20:01:53 user nova-compute[74638]:     </arch>
Nov 08 20:01:53 user nova-compute[74638]:     <features>
Nov 08 20:01:53 user nova-compute[74638]:       <cpuselection/>
Nov 08 20:01:53 user nova-compute[74638]:       <deviceboot/>
Nov 08 20:01:53 user nova-compute[74638]:       <disksnapshot default='on' toggle='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     </features>
Nov 08 20:01:53 user nova-compute[74638]:   </guest>
Nov 08 20:01:53 user nova-compute[74638]: </capabilities>
Nov 08 20:01:53 user nova-compute[74638]: 
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 20:01:53 user nova-compute[74638]: <domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 20:01:53 user nova-compute[74638]:   <domain>kvm</domain>
Nov 08 20:01:53 user nova-compute[74638]:   <machine>pc-i440fx-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:   <arch>i686</arch>
Nov 08 20:01:53 user nova-compute[74638]:   <vcpu max='255'/>
Nov 08 20:01:53 user nova-compute[74638]:   <iothreads supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:   <os supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='firmware'/>
Nov 08 20:01:53 user nova-compute[74638]:     <loader supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>rom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pflash</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='readonly'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='secure'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </loader>
Nov 08 20:01:53 user nova-compute[74638]:   </os>
Nov 08 20:01:53 user nova-compute[74638]:   <cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-passthrough' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='hostPassthroughMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='maximum' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='maximumMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-model' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='umip'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibpb'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibrs'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='erms'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='lm'/>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='custom' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>qemu64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>qemu32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>phenom</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>n270</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>kvm64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>coreduo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>core2duo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>athlon</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Westmere</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Snowridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Penryn</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G5</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G4</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G1</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Rome</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Milan</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Dhyana</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cooperlake</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Conroe</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>486</model>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:   </cpu>
Nov 08 20:01:53 user nova-compute[74638]:   <memoryBacking supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='sourceType'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>file</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>anonymous</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>memfd</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:   </memoryBacking>
Nov 08 20:01:53 user nova-compute[74638]:   <devices>
Nov 08 20:01:53 user nova-compute[74638]:     <disk supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='diskDevice'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>disk</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cdrom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>floppy</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>lun</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='bus'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ide</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>fdc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sata</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </disk>
Nov 08 20:01:53 user nova-compute[74638]:     <graphics supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sdl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vnc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>spice</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egl-headless</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </graphics>
Nov 08 20:01:53 user nova-compute[74638]:     <video supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='modelType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cirrus</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vmvga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>qxl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>none</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>bochs</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ramfb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </video>
Nov 08 20:01:53 user nova-compute[74638]:     <hostdev supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='mode'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>subsystem</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='startupPolicy'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>default</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>mandatory</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>requisite</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>optional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='subsysType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pci</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='capsType'/>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='pciBackend'/>
Nov 08 20:01:53 user nova-compute[74638]:     </hostdev>
Nov 08 20:01:53 user nova-compute[74638]:     <rng supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>random</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egd</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>builtin</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </rng>
Nov 08 20:01:53 user nova-compute[74638]:     <filesystem supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='driverType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>path</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>handle</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtiofs</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </filesystem>
Nov 08 20:01:53 user nova-compute[74638]:     <tpm supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-tis</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-crb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>passthrough</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>emulator</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </tpm>
Nov 08 20:01:53 user nova-compute[74638]:   </devices>
Nov 08 20:01:53 user nova-compute[74638]:   <features>
Nov 08 20:01:53 user nova-compute[74638]:     <gic supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <vmcoreinfo supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <genid supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backingStoreInput supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backup supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <sev supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:   </features>
Nov 08 20:01:53 user nova-compute[74638]: </domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 20:01:53 user nova-compute[74638]: <domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 20:01:53 user nova-compute[74638]:   <domain>kvm</domain>
Nov 08 20:01:53 user nova-compute[74638]:   <machine>pc-i440fx-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:   <arch>i686</arch>
Nov 08 20:01:53 user nova-compute[74638]:   <vcpu max='255'/>
Nov 08 20:01:53 user nova-compute[74638]:   <iothreads supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:   <os supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='firmware'/>
Nov 08 20:01:53 user nova-compute[74638]:     <loader supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>rom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pflash</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='readonly'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='secure'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </loader>
Nov 08 20:01:53 user nova-compute[74638]:   </os>
Nov 08 20:01:53 user nova-compute[74638]:   <cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-passthrough' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='hostPassthroughMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='maximum' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='maximumMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-model' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='umip'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibpb'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibrs'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='erms'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='lm'/>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='custom' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>qemu64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>qemu32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>phenom</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>n270</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>kvm64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>coreduo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>core2duo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>athlon</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Westmere</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Snowridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Penryn</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G5</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G4</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G1</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Rome</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Milan</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Dhyana</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cooperlake</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Conroe</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>486</model>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:   </cpu>
Nov 08 20:01:53 user nova-compute[74638]:   <memoryBacking supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='sourceType'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>file</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>anonymous</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>memfd</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:   </memoryBacking>
Nov 08 20:01:53 user nova-compute[74638]:   <devices>
Nov 08 20:01:53 user nova-compute[74638]:     <disk supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='diskDevice'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>disk</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cdrom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>floppy</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>lun</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='bus'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ide</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>fdc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sata</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </disk>
Nov 08 20:01:53 user nova-compute[74638]:     <graphics supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sdl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vnc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>spice</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egl-headless</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </graphics>
Nov 08 20:01:53 user nova-compute[74638]:     <video supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='modelType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cirrus</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vmvga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>qxl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>none</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>bochs</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ramfb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </video>
Nov 08 20:01:53 user nova-compute[74638]:     <hostdev supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='mode'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>subsystem</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='startupPolicy'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>default</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>mandatory</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>requisite</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>optional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='subsysType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pci</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='capsType'/>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='pciBackend'/>
Nov 08 20:01:53 user nova-compute[74638]:     </hostdev>
Nov 08 20:01:53 user nova-compute[74638]:     <rng supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>random</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egd</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>builtin</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </rng>
Nov 08 20:01:53 user nova-compute[74638]:     <filesystem supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='driverType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>path</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>handle</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtiofs</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </filesystem>
Nov 08 20:01:53 user nova-compute[74638]:     <tpm supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-tis</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-crb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>passthrough</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>emulator</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </tpm>
Nov 08 20:01:53 user nova-compute[74638]:   </devices>
Nov 08 20:01:53 user nova-compute[74638]:   <features>
Nov 08 20:01:53 user nova-compute[74638]:     <gic supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <vmcoreinfo supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <genid supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backingStoreInput supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backup supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <sev supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:   </features>
Nov 08 20:01:53 user nova-compute[74638]: </domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 20:01:53 user nova-compute[74638]: <domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 20:01:53 user nova-compute[74638]:   <domain>kvm</domain>
Nov 08 20:01:53 user nova-compute[74638]:   <machine>pc-q35-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:   <arch>i686</arch>
Nov 08 20:01:53 user nova-compute[74638]:   <vcpu max='288'/>
Nov 08 20:01:53 user nova-compute[74638]:   <iothreads supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:   <os supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='firmware'/>
Nov 08 20:01:53 user nova-compute[74638]:     <loader supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>rom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pflash</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='readonly'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='secure'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </loader>
Nov 08 20:01:53 user nova-compute[74638]:   </os>
Nov 08 20:01:53 user nova-compute[74638]:   <cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-passthrough' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='hostPassthroughMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='maximum' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='maximumMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-model' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='umip'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibpb'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibrs'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='erms'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='lm'/>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='custom' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>qemu64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>qemu32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>phenom</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>n270</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>kvm64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>coreduo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>core2duo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>athlon</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Westmere</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Snowridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Penryn</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G5</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G4</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G1</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Rome</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Milan</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Dhyana</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cooperlake</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Conroe</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>486</model>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:   </cpu>
Nov 08 20:01:53 user nova-compute[74638]:   <memoryBacking supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='sourceType'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>file</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>anonymous</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>memfd</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:   </memoryBacking>
Nov 08 20:01:53 user nova-compute[74638]:   <devices>
Nov 08 20:01:53 user nova-compute[74638]:     <disk supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='diskDevice'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>disk</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cdrom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>floppy</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>lun</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='bus'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>fdc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sata</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </disk>
Nov 08 20:01:53 user nova-compute[74638]:     <graphics supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sdl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vnc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>spice</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egl-headless</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </graphics>
Nov 08 20:01:53 user nova-compute[74638]:     <video supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='modelType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cirrus</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vmvga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>qxl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>none</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>bochs</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ramfb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </video>
Nov 08 20:01:53 user nova-compute[74638]:     <hostdev supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='mode'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>subsystem</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='startupPolicy'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>default</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>mandatory</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>requisite</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>optional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='subsysType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pci</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='capsType'/>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='pciBackend'/>
Nov 08 20:01:53 user nova-compute[74638]:     </hostdev>
Nov 08 20:01:53 user nova-compute[74638]:     <rng supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>random</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egd</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>builtin</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </rng>
Nov 08 20:01:53 user nova-compute[74638]:     <filesystem supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='driverType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>path</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>handle</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtiofs</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </filesystem>
Nov 08 20:01:53 user nova-compute[74638]:     <tpm supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-tis</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-crb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>passthrough</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>emulator</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </tpm>
Nov 08 20:01:53 user nova-compute[74638]:   </devices>
Nov 08 20:01:53 user nova-compute[74638]:   <features>
Nov 08 20:01:53 user nova-compute[74638]:     <gic supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <vmcoreinfo supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <genid supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backingStoreInput supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backup supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <sev supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:   </features>
Nov 08 20:01:53 user nova-compute[74638]: </domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 20:01:53 user nova-compute[74638]: <domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 20:01:53 user nova-compute[74638]:   <domain>kvm</domain>
Nov 08 20:01:53 user nova-compute[74638]:   <machine>pc-q35-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:   <arch>i686</arch>
Nov 08 20:01:53 user nova-compute[74638]:   <vcpu max='288'/>
Nov 08 20:01:53 user nova-compute[74638]:   <iothreads supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:   <os supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='firmware'/>
Nov 08 20:01:53 user nova-compute[74638]:     <loader supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>rom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pflash</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='readonly'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='secure'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </loader>
Nov 08 20:01:53 user nova-compute[74638]:   </os>
Nov 08 20:01:53 user nova-compute[74638]:   <cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-passthrough' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='hostPassthroughMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='maximum' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='maximumMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-model' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='umip'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibpb'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibrs'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='erms'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='lm'/>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='custom' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>qemu64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>qemu32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>phenom</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>n270</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>kvm64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>coreduo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>core2duo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>athlon</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Westmere</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Snowridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Penryn</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G5</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G4</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G1</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Rome</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Milan</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Dhyana</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cooperlake</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Conroe</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>486</model>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:   </cpu>
Nov 08 20:01:53 user nova-compute[74638]:   <memoryBacking supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='sourceType'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>file</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>anonymous</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>memfd</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:   </memoryBacking>
Nov 08 20:01:53 user nova-compute[74638]:   <devices>
Nov 08 20:01:53 user nova-compute[74638]:     <disk supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='diskDevice'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>disk</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cdrom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>floppy</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>lun</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='bus'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>fdc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sata</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </disk>
Nov 08 20:01:53 user nova-compute[74638]:     <graphics supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sdl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vnc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>spice</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egl-headless</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </graphics>
Nov 08 20:01:53 user nova-compute[74638]:     <video supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='modelType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cirrus</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vmvga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>qxl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>none</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>bochs</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ramfb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </video>
Nov 08 20:01:53 user nova-compute[74638]:     <hostdev supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='mode'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>subsystem</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='startupPolicy'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>default</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>mandatory</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>requisite</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>optional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='subsysType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pci</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='capsType'/>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='pciBackend'/>
Nov 08 20:01:53 user nova-compute[74638]:     </hostdev>
Nov 08 20:01:53 user nova-compute[74638]:     <rng supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>random</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egd</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>builtin</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </rng>
Nov 08 20:01:53 user nova-compute[74638]:     <filesystem supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='driverType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>path</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>handle</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtiofs</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </filesystem>
Nov 08 20:01:53 user nova-compute[74638]:     <tpm supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-tis</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-crb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>passthrough</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>emulator</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </tpm>
Nov 08 20:01:53 user nova-compute[74638]:   </devices>
Nov 08 20:01:53 user nova-compute[74638]:   <features>
Nov 08 20:01:53 user nova-compute[74638]:     <gic supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <vmcoreinfo supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <genid supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backingStoreInput supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backup supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <sev supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:   </features>
Nov 08 20:01:53 user nova-compute[74638]: </domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 20:01:53 user nova-compute[74638]: <domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 20:01:53 user nova-compute[74638]:   <domain>kvm</domain>
Nov 08 20:01:53 user nova-compute[74638]:   <machine>pc-i440fx-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:   <arch>x86_64</arch>
Nov 08 20:01:53 user nova-compute[74638]:   <vcpu max='255'/>
Nov 08 20:01:53 user nova-compute[74638]:   <iothreads supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:   <os supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='firmware'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>efi</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:     <loader supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>rom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pflash</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='readonly'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='secure'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </loader>
Nov 08 20:01:53 user nova-compute[74638]:   </os>
Nov 08 20:01:53 user nova-compute[74638]:   <cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-passthrough' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='hostPassthroughMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='maximum' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='maximumMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-model' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='umip'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='invtsc'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibpb'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibrs'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='rsba'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='erms'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='custom' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>qemu64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>qemu32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>phenom</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>n270</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>coreduo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>core2duo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>athlon</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Westmere</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Snowridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Penryn</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G5</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G4</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Opteron_G1</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Rome</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Milan</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Dhyana</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cooperlake</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Conroe</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>486</model>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:   </cpu>
Nov 08 20:01:53 user nova-compute[74638]:   <memoryBacking supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='sourceType'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>file</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>anonymous</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>memfd</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:   </memoryBacking>
Nov 08 20:01:53 user nova-compute[74638]:   <devices>
Nov 08 20:01:53 user nova-compute[74638]:     <disk supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='diskDevice'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>disk</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cdrom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>floppy</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>lun</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='bus'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ide</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>fdc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sata</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </disk>
Nov 08 20:01:53 user nova-compute[74638]:     <graphics supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sdl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vnc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>spice</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egl-headless</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </graphics>
Nov 08 20:01:53 user nova-compute[74638]:     <video supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='modelType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cirrus</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vmvga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>qxl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>none</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>bochs</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ramfb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </video>
Nov 08 20:01:53 user nova-compute[74638]:     <hostdev supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='mode'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>subsystem</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='startupPolicy'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>default</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>mandatory</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>requisite</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>optional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='subsysType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pci</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='capsType'/>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='pciBackend'/>
Nov 08 20:01:53 user nova-compute[74638]:     </hostdev>
Nov 08 20:01:53 user nova-compute[74638]:     <rng supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>random</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egd</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>builtin</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </rng>
Nov 08 20:01:53 user nova-compute[74638]:     <filesystem supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='driverType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>path</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>handle</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtiofs</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </filesystem>
Nov 08 20:01:53 user nova-compute[74638]:     <tpm supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-tis</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-crb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>passthrough</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>emulator</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </tpm>
Nov 08 20:01:53 user nova-compute[74638]:   </devices>
Nov 08 20:01:53 user nova-compute[74638]:   <features>
Nov 08 20:01:53 user nova-compute[74638]:     <gic supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <vmcoreinfo supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <genid supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backingStoreInput supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backup supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <sev supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:   </features>
Nov 08 20:01:53 user nova-compute[74638]: </domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 20:01:53 user nova-compute[74638]: <domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 20:01:53 user nova-compute[74638]:   <domain>kvm</domain>
Nov 08 20:01:53 user nova-compute[74638]:   <machine>pc-i440fx-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:   <arch>x86_64</arch>
Nov 08 20:01:53 user nova-compute[74638]:   <vcpu max='255'/>
Nov 08 20:01:53 user nova-compute[74638]:   <iothreads supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:   <os supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='firmware'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>efi</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:     <loader supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>rom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pflash</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='readonly'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='secure'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </loader>
Nov 08 20:01:53 user nova-compute[74638]:   </os>
Nov 08 20:01:53 user nova-compute[74638]:   <cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-passthrough' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='hostPassthroughMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='maximum' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='maximumMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-model' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='umip'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='invtsc'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibpb'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibrs'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='rsba'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='erms'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='custom' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>qemu64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>qemu32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>phenom</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>n270</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>coreduo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>core2duo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>athlon</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Westmere</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Snowridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Penryn</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G5</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G4</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Opteron_G1</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Rome</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Milan</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Dhyana</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cooperlake</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Conroe</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>486</model>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:   </cpu>
Nov 08 20:01:53 user nova-compute[74638]:   <memoryBacking supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='sourceType'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>file</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>anonymous</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>memfd</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:   </memoryBacking>
Nov 08 20:01:53 user nova-compute[74638]:   <devices>
Nov 08 20:01:53 user nova-compute[74638]:     <disk supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='diskDevice'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>disk</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cdrom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>floppy</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>lun</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='bus'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ide</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>fdc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sata</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </disk>
Nov 08 20:01:53 user nova-compute[74638]:     <graphics supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sdl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vnc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>spice</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egl-headless</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </graphics>
Nov 08 20:01:53 user nova-compute[74638]:     <video supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='modelType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cirrus</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vmvga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>qxl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>none</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>bochs</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ramfb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </video>
Nov 08 20:01:53 user nova-compute[74638]:     <hostdev supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='mode'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>subsystem</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='startupPolicy'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>default</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>mandatory</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>requisite</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>optional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='subsysType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pci</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='capsType'/>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='pciBackend'/>
Nov 08 20:01:53 user nova-compute[74638]:     </hostdev>
Nov 08 20:01:53 user nova-compute[74638]:     <rng supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>random</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egd</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>builtin</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </rng>
Nov 08 20:01:53 user nova-compute[74638]:     <filesystem supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='driverType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>path</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>handle</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtiofs</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </filesystem>
Nov 08 20:01:53 user nova-compute[74638]:     <tpm supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-tis</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-crb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>passthrough</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>emulator</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </tpm>
Nov 08 20:01:53 user nova-compute[74638]:   </devices>
Nov 08 20:01:53 user nova-compute[74638]:   <features>
Nov 08 20:01:53 user nova-compute[74638]:     <gic supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <vmcoreinfo supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <genid supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backingStoreInput supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backup supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <sev supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:   </features>
Nov 08 20:01:53 user nova-compute[74638]: </domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 20:01:53 user nova-compute[74638]: <domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 20:01:53 user nova-compute[74638]:   <domain>kvm</domain>
Nov 08 20:01:53 user nova-compute[74638]:   <machine>pc-q35-6.2</machine>
Nov 08 20:01:53 user nova-compute[74638]:   <arch>x86_64</arch>
Nov 08 20:01:53 user nova-compute[74638]:   <vcpu max='288'/>
Nov 08 20:01:53 user nova-compute[74638]:   <iothreads supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:   <os supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='firmware'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>efi</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:     <loader supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>rom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pflash</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='readonly'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='secure'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </loader>
Nov 08 20:01:53 user nova-compute[74638]:   </os>
Nov 08 20:01:53 user nova-compute[74638]:   <cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-passthrough' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='hostPassthroughMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='maximum' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='maximumMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-model' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='umip'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='invtsc'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibpb'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibrs'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='rsba'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='erms'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='custom' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>qemu64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>qemu32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>phenom</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>n270</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>coreduo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>core2duo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>athlon</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Westmere</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Snowridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Penryn</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G5</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G4</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Opteron_G1</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Rome</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Milan</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Dhyana</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cooperlake</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Conroe</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>486</model>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:   </cpu>
Nov 08 20:01:53 user nova-compute[74638]:   <memoryBacking supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='sourceType'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>file</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>anonymous</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>memfd</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:   </memoryBacking>
Nov 08 20:01:53 user nova-compute[74638]:   <devices>
Nov 08 20:01:53 user nova-compute[74638]:     <disk supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='diskDevice'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>disk</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cdrom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>floppy</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>lun</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='bus'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>fdc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sata</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </disk>
Nov 08 20:01:53 user nova-compute[74638]:     <graphics supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sdl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vnc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>spice</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egl-headless</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </graphics>
Nov 08 20:01:53 user nova-compute[74638]:     <video supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='modelType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cirrus</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vmvga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>qxl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>none</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>bochs</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ramfb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </video>
Nov 08 20:01:53 user nova-compute[74638]:     <hostdev supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='mode'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>subsystem</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='startupPolicy'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>default</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>mandatory</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>requisite</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>optional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='subsysType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pci</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='capsType'/>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='pciBackend'/>
Nov 08 20:01:53 user nova-compute[74638]:     </hostdev>
Nov 08 20:01:53 user nova-compute[74638]:     <rng supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>random</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egd</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>builtin</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </rng>
Nov 08 20:01:53 user nova-compute[74638]:     <filesystem supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='driverType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>path</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>handle</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtiofs</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </filesystem>
Nov 08 20:01:53 user nova-compute[74638]:     <tpm supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-tis</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-crb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>passthrough</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>emulator</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </tpm>
Nov 08 20:01:53 user nova-compute[74638]:   </devices>
Nov 08 20:01:53 user nova-compute[74638]:   <features>
Nov 08 20:01:53 user nova-compute[74638]:     <gic supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <vmcoreinfo supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <genid supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backingStoreInput supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backup supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <sev supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:   </features>
Nov 08 20:01:53 user nova-compute[74638]: </domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 20:01:53 user nova-compute[74638]: <domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 20:01:53 user nova-compute[74638]:   <domain>kvm</domain>
Nov 08 20:01:53 user nova-compute[74638]:   <machine>pc-q35-jammy</machine>
Nov 08 20:01:53 user nova-compute[74638]:   <arch>x86_64</arch>
Nov 08 20:01:53 user nova-compute[74638]:   <vcpu max='288'/>
Nov 08 20:01:53 user nova-compute[74638]:   <iothreads supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:   <os supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='firmware'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>efi</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:     <loader supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>rom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pflash</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='readonly'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='secure'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>yes</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>no</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </loader>
Nov 08 20:01:53 user nova-compute[74638]:   </os>
Nov 08 20:01:53 user nova-compute[74638]:   <cpu>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-passthrough' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='hostPassthroughMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='maximum' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='maximumMigratable'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>on</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>off</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='host-model' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <vendor>Intel</vendor>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ss'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='vmx'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pcid'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='hypervisor'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arat'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='umip'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='md-clear'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='invtsc'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibpb'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='ibrs'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-stibp'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='rsba'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='erms'/>
Nov 08 20:01:53 user nova-compute[74638]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:     <mode name='custom' supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>qemu64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>qemu32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>phenom</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>pentium</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>n270</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm64</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>kvm32</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>coreduo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>core2duo</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>athlon</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Westmere</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Snowridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Skylake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>SandyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Penryn</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G5</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G4</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G3</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Opteron_G2</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Opteron_G1</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>IvyBridge</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Icelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Haswell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Rome</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-Milan</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>EPYC</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Dhyana</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cooperlake</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>Conroe</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='no'>Broadwell</model>
Nov 08 20:01:53 user nova-compute[74638]:       <model usable='yes'>486</model>
Nov 08 20:01:53 user nova-compute[74638]:     </mode>
Nov 08 20:01:53 user nova-compute[74638]:   </cpu>
Nov 08 20:01:53 user nova-compute[74638]:   <memoryBacking supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:     <enum name='sourceType'>
Nov 08 20:01:53 user nova-compute[74638]:       <value>file</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>anonymous</value>
Nov 08 20:01:53 user nova-compute[74638]:       <value>memfd</value>
Nov 08 20:01:53 user nova-compute[74638]:     </enum>
Nov 08 20:01:53 user nova-compute[74638]:   </memoryBacking>
Nov 08 20:01:53 user nova-compute[74638]:   <devices>
Nov 08 20:01:53 user nova-compute[74638]:     <disk supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='diskDevice'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>disk</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cdrom</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>floppy</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>lun</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='bus'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>fdc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sata</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </disk>
Nov 08 20:01:53 user nova-compute[74638]:     <graphics supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='type'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>sdl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vnc</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>spice</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egl-headless</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </graphics>
Nov 08 20:01:53 user nova-compute[74638]:     <video supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='modelType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>cirrus</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>vmvga</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>qxl</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>none</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>bochs</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>ramfb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </video>
Nov 08 20:01:53 user nova-compute[74638]:     <hostdev supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='mode'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>subsystem</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='startupPolicy'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>default</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>mandatory</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>requisite</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>optional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='subsysType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>usb</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>pci</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>scsi</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='capsType'/>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='pciBackend'/>
Nov 08 20:01:53 user nova-compute[74638]:     </hostdev>
Nov 08 20:01:53 user nova-compute[74638]:     <rng supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtio-non-transitional</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>random</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>egd</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>builtin</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </rng>
Nov 08 20:01:53 user nova-compute[74638]:     <filesystem supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='driverType'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>path</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>handle</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>virtiofs</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </filesystem>
Nov 08 20:01:53 user nova-compute[74638]:     <tpm supported='yes'>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='model'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-tis</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>tpm-crb</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:       <enum name='backendModel'>
Nov 08 20:01:53 user nova-compute[74638]:         <value>passthrough</value>
Nov 08 20:01:53 user nova-compute[74638]:         <value>emulator</value>
Nov 08 20:01:53 user nova-compute[74638]:       </enum>
Nov 08 20:01:53 user nova-compute[74638]:     </tpm>
Nov 08 20:01:53 user nova-compute[74638]:   </devices>
Nov 08 20:01:53 user nova-compute[74638]:   <features>
Nov 08 20:01:53 user nova-compute[74638]:     <gic supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:     <vmcoreinfo supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <genid supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backingStoreInput supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <backup supported='yes'/>
Nov 08 20:01:53 user nova-compute[74638]:     <sev supported='no'/>
Nov 08 20:01:53 user nova-compute[74638]:   </features>
Nov 08 20:01:53 user nova-compute[74638]: </domainCapabilities>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74638) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74638) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Checking secure boot support for host arch (x86_64) {{(pid=74638) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Checking secure boot support for host arch (x86_64) {{(pid=74638) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Checking secure boot support for host arch (x86_64) {{(pid=74638) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Checking secure boot support for host arch (x86_64) {{(pid=74638) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Checking secure boot support for host arch (x86_64) {{(pid=74638) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 20:01:53 user nova-compute[74638]: INFO nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Secure Boot support detected
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] cpu compare xml: <cpu match="exact">
Nov 08 20:01:53 user nova-compute[74638]:   <model>Nehalem</model>
Nov 08 20:01:53 user nova-compute[74638]: </cpu>
Nov 08 20:01:53 user nova-compute[74638]:  {{(pid=74638) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 20:01:53 user nova-compute[74638]: INFO nova.virt.node [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Generated node identity cf9a8087-10bd-4ed4-a234-599b2cfc0bb8
Nov 08 20:01:53 user nova-compute[74638]: INFO nova.virt.node [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Wrote node identity cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 to /opt/stack/data/nova/compute_id
Nov 08 20:01:53 user nova-compute[74638]: WARNING nova.compute.manager [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Compute nodes ['cf9a8087-10bd-4ed4-a234-599b2cfc0bb8'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 20:01:53 user nova-compute[74638]: INFO nova.compute.manager [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 20:01:53 user nova-compute[74638]: WARNING nova.compute.manager [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 20:01:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:01:53 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:01:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:01:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Hypervisor/Node resource view: name=user free_ram=10989MB free_disk=26.272384643554688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:01:54 user nova-compute[74638]: WARNING nova.compute.resource_tracker [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] No compute node record for user:cf9a8087-10bd-4ed4-a234-599b2cfc0bb8: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 could not be found.
Nov 08 20:01:54 user nova-compute[74638]: INFO nova.compute.resource_tracker [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Compute node record created for user:user with uuid: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:01:54 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] [req-ad792f31-8b79-4cad-9ace-4aa1c9c7f908] Created resource provider record via placement API for resource provider with UUID cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 and name user.
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74638) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 20:01:54 user nova-compute[74638]: INFO nova.virt.libvirt.host [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] kernel doesn't support AMD SEV
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Libvirt baseline CPU <cpu>
Nov 08 20:01:54 user nova-compute[74638]:   <arch>x86_64</arch>
Nov 08 20:01:54 user nova-compute[74638]:   <model>Nehalem</model>
Nov 08 20:01:54 user nova-compute[74638]:   <vendor>Intel</vendor>
Nov 08 20:01:54 user nova-compute[74638]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 20:01:54 user nova-compute[74638]: </cpu>
Nov 08 20:01:54 user nova-compute[74638]:  {{(pid=74638) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Updated inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Updating resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 generation from 0 to 1 during operation: update_inventory {{(pid=74638) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Updating resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 generation from 1 to 2 during operation: update_traits {{(pid=74638) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.745s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.service [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Creating RPC server for service compute {{(pid=74638) start /opt/stack/nova/nova/service.py:182}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.service [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] Join ServiceGroup membership for this service compute {{(pid=74638) start /opt/stack/nova/nova/service.py:199}}
Nov 08 20:01:54 user nova-compute[74638]: DEBUG nova.servicegroup.drivers.db [None req-e347bd42-e4bf-43f7-890c-0d2ef2c6580c None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74638) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 20:02:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:02:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:02:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:02:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=10440MB free_disk=26.176162719726562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:02:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:02:46 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:02:46 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:02:46 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:02:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:03:46 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:03:46 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=10372MB free_disk=26.24105453491211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:03:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:04:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:04:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:04:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=10399MB free_disk=25.995410919189453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:04:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:04:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:04:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:04:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:05:47 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:05:47 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:05:47 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=9650MB free_disk=26.021167755126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:05:47 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:05:48 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:05:48 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:05:48 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:05:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:05:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:05:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:05:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:05:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:05:51 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:05:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:05:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:05:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:05:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:05:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:05:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:05:55 user nova-compute[74638]: INFO nova.compute.claims [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Claim successful on node user
Nov 08 20:05:55 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:05:55 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:05:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:05:55 user nova-compute[74638]: DEBUG nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:05:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:05:56 user nova-compute[74638]: DEBUG nova.network.neutron [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:05:56 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:05:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:05:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:05:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:05:56 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Creating image(s)
Nov 08 20:05:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "/opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:05:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "/opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:05:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "/opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:05:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:05:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:05:57 user nova-compute[74638]: DEBUG nova.policy [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e00b53564f5f40838d0b2bf80703aca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8e11b476c42cda1734e93d770bca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:05:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:05:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:05:57 user nova-compute[74638]: DEBUG nova.virt.images [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] 2378b081-1a49-4717-81bb-a291ba1a9d32 was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:05:57 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:05:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835.part /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:05:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835.part /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835.converted" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:05:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:05:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:05:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.787s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:05:58 user nova-compute[74638]: INFO oslo.privsep.daemon [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp088lntt7/privsep.sock']
Nov 08 20:05:58 user sudo[83886]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp088lntt7/privsep.sock
Nov 08 20:05:58 user sudo[83886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 20:05:59 user nova-compute[74638]: DEBUG nova.network.neutron [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Successfully created port: a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:05:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "07aab635-2120-4d29-8e6b-40a725ed8f37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:05:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:05:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:05:59 user sudo[83886]: pam_unix(sudo:session): session closed for user root
Nov 08 20:05:59 user nova-compute[74638]: INFO oslo.privsep.daemon [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Spawned new privsep daemon via rootwrap
Nov 08 20:05:59 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 20:05:59 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 20:05:59 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 20:05:59 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83891
Nov 08 20:05:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:05:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:05:59 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:05:59 user nova-compute[74638]: INFO nova.compute.claims [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Claim successful on node user
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.network.neutron [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.230s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.policy [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d337a855b2f47849995109533421233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc60419b64f4d509a058b6ad7c756f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:06:00 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk 1073741824" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.428s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:06:00 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Creating image(s)
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "/opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "/opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "/opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Cannot resize image /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Ensure instance console log exists: /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.270s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.171s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk 1073741824" returned: 0 in 0.046s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Cannot resize image /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Ensure instance console log exists: /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:06:02 user nova-compute[74638]: INFO nova.compute.claims [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Claim successful on node user
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.network.neutron [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Successfully created port: d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.network.neutron [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Successfully updated port: a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquired lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.network.neutron [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:06:02 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.policy [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db7a353114a446b0a3294508e169cd3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2cebdae35a49a7a6d6fbcf4b0cd1ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:06:02 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Creating image(s)
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "/opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "/opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "/opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.network.neutron [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-c09a9d5c-b0c3-4963-93fe-033dc51cb0a7 req-bfe414e1-216f-4fd5-b48a-6add6c0ece2e service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received event network-changed-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-c09a9d5c-b0c3-4963-93fe-033dc51cb0a7 req-bfe414e1-216f-4fd5-b48a-6add6c0ece2e service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Refreshing instance network info cache due to event network-changed-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c09a9d5c-b0c3-4963-93fe-033dc51cb0a7 req-bfe414e1-216f-4fd5-b48a-6add6c0ece2e service nova] Acquiring lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.236s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.257s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk 1073741824" returned: 0 in 0.041s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:06:03 user nova-compute[74638]: INFO nova.compute.claims [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Claim successful on node user
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.network.neutron [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Updating instance_info_cache with network_info: [{"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Releasing lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Instance network_info: |[{"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c09a9d5c-b0c3-4963-93fe-033dc51cb0a7 req-bfe414e1-216f-4fd5-b48a-6add6c0ece2e service nova] Acquired lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.network.neutron [req-c09a9d5c-b0c3-4963-93fe-033dc51cb0a7 req-bfe414e1-216f-4fd5-b48a-6add6c0ece2e service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Refreshing network info cache for port a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Start _get_guest_xml network_info=[{"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:03 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:03 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2089777493',display_name='tempest-DeleteServersTestJSON-server-2089777493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2089777493',id=1,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d8e11b476c42cda1734e93d770bca2',ramdisk_id='',reservation_id='r-36xdptbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-67210331',owner_user_name='tempest-DeleteServersTestJSON-67210331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:05:56Z,user_data=None,user_id='e00b53564f5f40838d0b2bf80703aca3',uuid=59bd23e8-fb0e-4e75-b03f-a239e068b86d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Converting VIF {"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:da:a2,bridge_name='br-int',has_traffic_filtering=True,id=a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587,network=Network(6e3e700d-8446-40ef-b64e-8c24fce40388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c18afc-fb') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.objects.instance [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lazy-loading 'pci_devices' on Instance uuid 59bd23e8-fb0e-4e75-b03f-a239e068b86d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:03 user nova-compute[74638]:   <uuid>59bd23e8-fb0e-4e75-b03f-a239e068b86d</uuid>
Nov 08 20:06:03 user nova-compute[74638]:   <name>instance-00000001</name>
Nov 08 20:06:03 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:03 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:03 user nova-compute[74638]:   <metadata>
Nov 08 20:06:03 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:03 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:03 user nova-compute[74638]:       <nova:name>tempest-DeleteServersTestJSON-server-2089777493</nova:name>
Nov 08 20:06:03 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:03</nova:creationTime>
Nov 08 20:06:03 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:03 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:03 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:03 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:03 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:03 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:03 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:03 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:03 user nova-compute[74638]:         <nova:user uuid="e00b53564f5f40838d0b2bf80703aca3">tempest-DeleteServersTestJSON-67210331-project-member</nova:user>
Nov 08 20:06:03 user nova-compute[74638]:         <nova:project uuid="46d8e11b476c42cda1734e93d770bca2">tempest-DeleteServersTestJSON-67210331</nova:project>
Nov 08 20:06:03 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:03 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:06:03 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:03 user nova-compute[74638]:         <nova:port uuid="a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587">
Nov 08 20:06:03 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 20:06:03 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:03 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:03 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:03 user nova-compute[74638]:   </metadata>
Nov 08 20:06:03 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:03 user nova-compute[74638]:     <system>
Nov 08 20:06:03 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:03 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:03 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:03 user nova-compute[74638]:       <entry name="serial">59bd23e8-fb0e-4e75-b03f-a239e068b86d</entry>
Nov 08 20:06:03 user nova-compute[74638]:       <entry name="uuid">59bd23e8-fb0e-4e75-b03f-a239e068b86d</entry>
Nov 08 20:06:03 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:03 user nova-compute[74638]:     </system>
Nov 08 20:06:03 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:03 user nova-compute[74638]:   <os>
Nov 08 20:06:03 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:03 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:03 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:03 user nova-compute[74638]:   </os>
Nov 08 20:06:03 user nova-compute[74638]:   <features>
Nov 08 20:06:03 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:03 user nova-compute[74638]:     <apic/>
Nov 08 20:06:03 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:03 user nova-compute[74638]:   </features>
Nov 08 20:06:03 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:03 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:03 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:03 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:03 user nova-compute[74638]:   </clock>
Nov 08 20:06:03 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:03 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:03 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:03 user nova-compute[74638]:   </cpu>
Nov 08 20:06:03 user nova-compute[74638]:   <devices>
Nov 08 20:06:03 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:03 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:03 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk"/>
Nov 08 20:06:03 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:06:03 user nova-compute[74638]:     </disk>
Nov 08 20:06:03 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:03 user nova-compute[74638]:       <mac address="fa:16:3e:8a:da:a2"/>
Nov 08 20:06:03 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:03 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:03 user nova-compute[74638]:       <target dev="tapa1c18afc-fb"/>
Nov 08 20:06:03 user nova-compute[74638]:     </interface>
Nov 08 20:06:03 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:03 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/console.log" append="off"/>
Nov 08 20:06:03 user nova-compute[74638]:     </serial>
Nov 08 20:06:03 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:03 user nova-compute[74638]:     <video>
Nov 08 20:06:03 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:03 user nova-compute[74638]:     </video>
Nov 08 20:06:03 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:03 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:03 user nova-compute[74638]:     </rng>
Nov 08 20:06:03 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:03 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:03 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:03 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:03 user nova-compute[74638]:   </devices>
Nov 08 20:06:03 user nova-compute[74638]: </domain>
Nov 08 20:06:03 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2089777493',display_name='tempest-DeleteServersTestJSON-server-2089777493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2089777493',id=1,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d8e11b476c42cda1734e93d770bca2',ramdisk_id='',reservation_id='r-36xdptbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-67210331',owner_user_name='tempest-DeleteServersTestJSON-67210331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:05:56Z,user_data=None,user_id='e00b53564f5f40838d0b2bf80703aca3',uuid=59bd23e8-fb0e-4e75-b03f-a239e068b86d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Converting VIF {"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:da:a2,bridge_name='br-int',has_traffic_filtering=True,id=a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587,network=Network(6e3e700d-8446-40ef-b64e-8c24fce40388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c18afc-fb') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:03 user nova-compute[74638]: DEBUG os_vif [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:da:a2,bridge_name='br-int',has_traffic_filtering=True,id=a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587,network=Network(6e3e700d-8446-40ef-b64e-8c24fce40388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c18afc-fb') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Created schema index Interface.name {{(pid=74638) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Created schema index Port.name {{(pid=74638) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Created schema index Bridge.name {{(pid=74638) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [POLLOUT] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Cannot resize image /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Ensure instance console log exists: /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b032eb4f-0d68-5f74-9221-44da86feb88a', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:04 user nova-compute[74638]: INFO oslo.privsep.daemon [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpnzraa566/privsep.sock']
Nov 08 20:06:04 user sudo[83956]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpnzraa566/privsep.sock
Nov 08 20:06:04 user sudo[83956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:06:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:06:04 user nova-compute[74638]: INFO nova.compute.claims [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Claim successful on node user
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.network.neutron [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Successfully updated port: d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquired lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.network.neutron [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:06:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Creating image(s)
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.policy [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b75bc3e9142b4bf6a314dc12b7a42bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6b297f1c394c5d84966b543d7a9cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.251s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-56edd523-8a5f-4fba-93a3-eaa1ca437827 req-679a430e-df5e-49f4-bc39-5dd2318728fe service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received event network-changed-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-56edd523-8a5f-4fba-93a3-eaa1ca437827 req-679a430e-df5e-49f4-bc39-5dd2318728fe service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Refreshing instance network info cache due to event network-changed-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-56edd523-8a5f-4fba-93a3-eaa1ca437827 req-679a430e-df5e-49f4-bc39-5dd2318728fe service nova] Acquiring lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.network.neutron [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Successfully created port: 8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.network.neutron [req-c09a9d5c-b0c3-4963-93fe-033dc51cb0a7 req-bfe414e1-216f-4fd5-b48a-6add6c0ece2e service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Updated VIF entry in instance network info cache for port a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.network.neutron [req-c09a9d5c-b0c3-4963-93fe-033dc51cb0a7 req-bfe414e1-216f-4fd5-b48a-6add6c0ece2e service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Updating instance_info_cache with network_info: [{"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk 1073741824" returned: 0 in 0.060s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c09a9d5c-b0c3-4963-93fe-033dc51cb0a7 req-bfe414e1-216f-4fd5-b48a-6add6c0ece2e service nova] Releasing lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.network.neutron [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:06:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:06:05 user sudo[83956]: pam_unix(sudo:session): session closed for user root
Nov 08 20:06:05 user nova-compute[74638]: INFO oslo.privsep.daemon [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Spawned new privsep daemon via rootwrap
Nov 08 20:06:05 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 20:06:05 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 20:06:05 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 20:06:05 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83966
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.212s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:06:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Creating image(s)
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "/opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "/opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "/opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.policy [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc302495f45a4ae1bd2524aa60ecbc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0b2492206349f197739ee10c95a28f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Cannot resize image /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Ensure instance console log exists: /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.161s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.network.neutron [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Updating instance_info_cache with network_info: [{"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Releasing lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Instance network_info: |[{"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-56edd523-8a5f-4fba-93a3-eaa1ca437827 req-679a430e-df5e-49f4-bc39-5dd2318728fe service nova] Acquired lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-56edd523-8a5f-4fba-93a3-eaa1ca437827 req-679a430e-df5e-49f4-bc39-5dd2318728fe service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Refreshing network info cache for port d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Start _get_guest_xml network_info=[{"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk 1073741824" returned: 0 in 0.055s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1c18afc-fb, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1c18afc-fb, col_values=(('qos', UUID('48efc464-09a5-4dad-b2a2-955e746bfb7f')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1c18afc-fb, col_values=(('external_ids', {'iface-id': 'a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:da:a2', 'vm-uuid': '59bd23e8-fb0e-4e75-b03f-a239e068b86d'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: INFO os_vif [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:da:a2,bridge_name='br-int',has_traffic_filtering=True,id=a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587,network=Network(6e3e700d-8446-40ef-b64e-8c24fce40388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c18afc-fb')
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1626769250',display_name='tempest-ServersNegativeTestJSON-server-1626769250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1626769250',id=2,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc60419b64f4d509a058b6ad7c756f6',ramdisk_id='',reservation_id='r-cgfr4bj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-300367152',owner_user_name='tempest-ServersNegativeTestJSON-300367152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:01Z,user_data=None,user_id='4d337a855b2f47849995109533421233',uuid=07aab635-2120-4d29-8e6b-40a725ed8f37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converting VIF {"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:72:93,bridge_name='br-int',has_traffic_filtering=True,id=d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a8d2b1-ad') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lazy-loading 'pci_devices' on Instance uuid 07aab635-2120-4d29-8e6b-40a725ed8f37 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:06 user nova-compute[74638]:   <uuid>07aab635-2120-4d29-8e6b-40a725ed8f37</uuid>
Nov 08 20:06:06 user nova-compute[74638]:   <name>instance-00000002</name>
Nov 08 20:06:06 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:06 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:06 user nova-compute[74638]:   <metadata>
Nov 08 20:06:06 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:06 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:06 user nova-compute[74638]:       <nova:name>tempest-ServersNegativeTestJSON-server-1626769250</nova:name>
Nov 08 20:06:06 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:06</nova:creationTime>
Nov 08 20:06:06 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:06 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:06 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:06 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:06 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:06 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:06 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:06 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:06 user nova-compute[74638]:         <nova:user uuid="4d337a855b2f47849995109533421233">tempest-ServersNegativeTestJSON-300367152-project-member</nova:user>
Nov 08 20:06:06 user nova-compute[74638]:         <nova:project uuid="fcc60419b64f4d509a058b6ad7c756f6">tempest-ServersNegativeTestJSON-300367152</nova:project>
Nov 08 20:06:06 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:06 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:06:06 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:06 user nova-compute[74638]:         <nova:port uuid="d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b">
Nov 08 20:06:06 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:06:06 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:06 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:06 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:06 user nova-compute[74638]:   </metadata>
Nov 08 20:06:06 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:06 user nova-compute[74638]:     <system>
Nov 08 20:06:06 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:06 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:06 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:06 user nova-compute[74638]:       <entry name="serial">07aab635-2120-4d29-8e6b-40a725ed8f37</entry>
Nov 08 20:06:06 user nova-compute[74638]:       <entry name="uuid">07aab635-2120-4d29-8e6b-40a725ed8f37</entry>
Nov 08 20:06:06 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:06 user nova-compute[74638]:     </system>
Nov 08 20:06:06 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:06 user nova-compute[74638]:   <os>
Nov 08 20:06:06 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:06 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:06 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:06 user nova-compute[74638]:   </os>
Nov 08 20:06:06 user nova-compute[74638]:   <features>
Nov 08 20:06:06 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:06 user nova-compute[74638]:     <apic/>
Nov 08 20:06:06 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:06 user nova-compute[74638]:   </features>
Nov 08 20:06:06 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:06 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:06 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:06 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:06 user nova-compute[74638]:   </clock>
Nov 08 20:06:06 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:06 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:06 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:06 user nova-compute[74638]:   </cpu>
Nov 08 20:06:06 user nova-compute[74638]:   <devices>
Nov 08 20:06:06 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:06 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:06 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk"/>
Nov 08 20:06:06 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:06:06 user nova-compute[74638]:     </disk>
Nov 08 20:06:06 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:06 user nova-compute[74638]:       <mac address="fa:16:3e:24:72:93"/>
Nov 08 20:06:06 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:06 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:06 user nova-compute[74638]:       <target dev="tapd5a8d2b1-ad"/>
Nov 08 20:06:06 user nova-compute[74638]:     </interface>
Nov 08 20:06:06 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:06 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/console.log" append="off"/>
Nov 08 20:06:06 user nova-compute[74638]:     </serial>
Nov 08 20:06:06 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:06 user nova-compute[74638]:     <video>
Nov 08 20:06:06 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:06 user nova-compute[74638]:     </video>
Nov 08 20:06:06 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:06 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:06 user nova-compute[74638]:     </rng>
Nov 08 20:06:06 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:06 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:06 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:06 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:06 user nova-compute[74638]:   </devices>
Nov 08 20:06:06 user nova-compute[74638]: </domain>
Nov 08 20:06:06 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1626769250',display_name='tempest-ServersNegativeTestJSON-server-1626769250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1626769250',id=2,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc60419b64f4d509a058b6ad7c756f6',ramdisk_id='',reservation_id='r-cgfr4bj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-300367152',owner_user_name='tempest-ServersNegativeTestJSON-300367152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:01Z,user_data=None,user_id='4d337a855b2f47849995109533421233',uuid=07aab635-2120-4d29-8e6b-40a725ed8f37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converting VIF {"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:72:93,bridge_name='br-int',has_traffic_filtering=True,id=d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a8d2b1-ad') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG os_vif [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:72:93,bridge_name='br-int',has_traffic_filtering=True,id=d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a8d2b1-ad') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52fb7df8-bdaa-59bf-8d86-68f4b6eaf540', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5a8d2b1-ad, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5a8d2b1-ad, col_values=(('qos', UUID('b4569030-bc38-4596-858b-880002bc7f47')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5a8d2b1-ad, col_values=(('external_ids', {'iface-id': 'd5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:72:93', 'vm-uuid': '07aab635-2120-4d29-8e6b-40a725ed8f37'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:06 user nova-compute[74638]: INFO os_vif [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:72:93,bridge_name='br-int',has_traffic_filtering=True,id=d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a8d2b1-ad')
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.227s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] No VIF found with MAC fa:16:3e:8a:da:a2, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] No VIF found with MAC fa:16:3e:24:72:93, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Cannot resize image /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Ensure instance console log exists: /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Successfully created port: 2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:06:07 user nova-compute[74638]: DEBUG nova.network.neutron [req-56edd523-8a5f-4fba-93a3-eaa1ca437827 req-679a430e-df5e-49f4-bc39-5dd2318728fe service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Updated VIF entry in instance network info cache for port d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:06:07 user nova-compute[74638]: DEBUG nova.network.neutron [req-56edd523-8a5f-4fba-93a3-eaa1ca437827 req-679a430e-df5e-49f4-bc39-5dd2318728fe service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Updating instance_info_cache with network_info: [{"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-56edd523-8a5f-4fba-93a3-eaa1ca437827 req-679a430e-df5e-49f4-bc39-5dd2318728fe service nova] Releasing lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Successfully created port: fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Successfully updated port: 8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquired lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:08 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Successfully updated port: 2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquired lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-829ec9ac-5ddf-4cf7-a0ee-d184ea9ca086 req-d80cefea-b621-4095-961f-521122fcf3ed service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-changed-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-829ec9ac-5ddf-4cf7-a0ee-d184ea9ca086 req-d80cefea-b621-4095-961f-521122fcf3ed service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Refreshing instance network info cache due to event network-changed-2dae479f-02ee-40bc-8a5d-436e3931e032. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-829ec9ac-5ddf-4cf7-a0ee-d184ea9ca086 req-d80cefea-b621-4095-961f-521122fcf3ed service nova] Acquiring lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-9f7c4bc6-a3f8-46f9-9552-0f69bbf7da6e req-1dc9e023-2a26-4272-b881-ab47d5b9acb7 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received event network-changed-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-9f7c4bc6-a3f8-46f9-9552-0f69bbf7da6e req-1dc9e023-2a26-4272-b881-ab47d5b9acb7 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Refreshing instance network info cache due to event network-changed-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9f7c4bc6-a3f8-46f9-9552-0f69bbf7da6e req-1dc9e023-2a26-4272-b881-ab47d5b9acb7 service nova] Acquiring lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Successfully updated port: fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating instance_info_cache with network_info: [{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquired lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Releasing lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance network_info: |[{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-829ec9ac-5ddf-4cf7-a0ee-d184ea9ca086 req-d80cefea-b621-4095-961f-521122fcf3ed service nova] Acquired lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.neutron [req-829ec9ac-5ddf-4cf7-a0ee-d184ea9ca086 req-d80cefea-b621-4095-961f-521122fcf3ed service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Refreshing network info cache for port 2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Start _get_guest_xml network_info=[{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:10 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:10 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'pci_devices' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:10 user nova-compute[74638]:   <uuid>f91c46b4-8ab6-4480-80e0-5e6df682e609</uuid>
Nov 08 20:06:10 user nova-compute[74638]:   <name>instance-00000004</name>
Nov 08 20:06:10 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:10 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:10 user nova-compute[74638]:   <metadata>
Nov 08 20:06:10 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:10 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeTestJSON-server-1261014533</nova:name>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:10</nova:creationTime>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:10 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:10 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:user uuid="b75bc3e9142b4bf6a314dc12b7a42bbe">tempest-AttachVolumeTestJSON-1773867302-project-member</nova:user>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:project uuid="3b6b297f1c394c5d84966b543d7a9cc6">tempest-AttachVolumeTestJSON-1773867302</nova:project>
Nov 08 20:06:10 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:port uuid="2dae479f-02ee-40bc-8a5d-436e3931e032">
Nov 08 20:06:10 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 20:06:10 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:10 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:10 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:10 user nova-compute[74638]:   </metadata>
Nov 08 20:06:10 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:10 user nova-compute[74638]:     <system>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="serial">f91c46b4-8ab6-4480-80e0-5e6df682e609</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="uuid">f91c46b4-8ab6-4480-80e0-5e6df682e609</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:10 user nova-compute[74638]:     </system>
Nov 08 20:06:10 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:10 user nova-compute[74638]:   <os>
Nov 08 20:06:10 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:10 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:10 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:10 user nova-compute[74638]:   </os>
Nov 08 20:06:10 user nova-compute[74638]:   <features>
Nov 08 20:06:10 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:10 user nova-compute[74638]:     <apic/>
Nov 08 20:06:10 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:10 user nova-compute[74638]:   </features>
Nov 08 20:06:10 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:10 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:10 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:10 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:10 user nova-compute[74638]:   </clock>
Nov 08 20:06:10 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:10 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:10 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:10 user nova-compute[74638]:   </cpu>
Nov 08 20:06:10 user nova-compute[74638]:   <devices>
Nov 08 20:06:10 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:10 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:10 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk"/>
Nov 08 20:06:10 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:06:10 user nova-compute[74638]:     </disk>
Nov 08 20:06:10 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:10 user nova-compute[74638]:       <mac address="fa:16:3e:32:99:5e"/>
Nov 08 20:06:10 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:10 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:10 user nova-compute[74638]:       <target dev="tap2dae479f-02"/>
Nov 08 20:06:10 user nova-compute[74638]:     </interface>
Nov 08 20:06:10 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:10 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/console.log" append="off"/>
Nov 08 20:06:10 user nova-compute[74638]:     </serial>
Nov 08 20:06:10 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:10 user nova-compute[74638]:     <video>
Nov 08 20:06:10 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:10 user nova-compute[74638]:     </video>
Nov 08 20:06:10 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:10 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:10 user nova-compute[74638]:     </rng>
Nov 08 20:06:10 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:10 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:10 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:10 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:10 user nova-compute[74638]:   </devices>
Nov 08 20:06:10 user nova-compute[74638]: </domain>
Nov 08 20:06:10 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG os_vif [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab8e4e0d-31a7-57ab-ac3a-c74f60ba0660', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dae479f-02, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dae479f-02, col_values=(('qos', UUID('a3f9cf40-b195-4bd5-9377-9dde2de1447c')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dae479f-02, col_values=(('external_ids', {'iface-id': '2dae479f-02ee-40bc-8a5d-436e3931e032', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:99:5e', 'vm-uuid': 'f91c46b4-8ab6-4480-80e0-5e6df682e609'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: INFO os_vif [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02')
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No VIF found with MAC fa:16:3e:32:99:5e, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updating instance_info_cache with network_info: [{"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Releasing lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Instance network_info: |[{"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9f7c4bc6-a3f8-46f9-9552-0f69bbf7da6e req-1dc9e023-2a26-4272-b881-ab47d5b9acb7 service nova] Acquired lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.neutron [req-9f7c4bc6-a3f8-46f9-9552-0f69bbf7da6e req-1dc9e023-2a26-4272-b881-ab47d5b9acb7 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Refreshing network info cache for port 8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Start _get_guest_xml network_info=[{"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:10 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:10 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1387226148',display_name='tempest-ServerActionsTestOtherB-server-1387226148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1387226148',id=3,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8A1RgZiaKFum/883dNVq7J+v3UCm/3/JFR42J7y5Hebbohx5tb1NTPsX/lXcVvbFBbJq0a6gwWQrQVd1WQF6MRsP1YE0d59iTG4w3v32bGJ2E8n6PhHZjT/RrZMTOHQ==',key_name='tempest-keypair-1075117626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da2cebdae35a49a7a6d6fbcf4b0cd1ee',ramdisk_id='',reservation_id='r-u0n8ymi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1698257018',owner_user_name='tempest-ServerActionsTestOtherB-1698257018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db7a353114a446b0a3294508e169cd3f',uuid=10037bd1-d710-4ce1-abe8-b1f5b657c828,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Converting VIF {"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:38:bb,bridge_name='br-int',has_traffic_filtering=True,id=8e07c583-ff9b-4cd7-938e-d9464fa8b1b8,network=Network(677302cb-0b2e-4e58-9adf-5e10929fa6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e07c583-ff') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lazy-loading 'pci_devices' on Instance uuid 10037bd1-d710-4ce1-abe8-b1f5b657c828 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:10 user nova-compute[74638]:   <uuid>10037bd1-d710-4ce1-abe8-b1f5b657c828</uuid>
Nov 08 20:06:10 user nova-compute[74638]:   <name>instance-00000003</name>
Nov 08 20:06:10 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:10 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:10 user nova-compute[74638]:   <metadata>
Nov 08 20:06:10 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:10 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:name>tempest-ServerActionsTestOtherB-server-1387226148</nova:name>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:10</nova:creationTime>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:10 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:10 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:user uuid="db7a353114a446b0a3294508e169cd3f">tempest-ServerActionsTestOtherB-1698257018-project-member</nova:user>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:project uuid="da2cebdae35a49a7a6d6fbcf4b0cd1ee">tempest-ServerActionsTestOtherB-1698257018</nova:project>
Nov 08 20:06:10 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:06:10 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:10 user nova-compute[74638]:         <nova:port uuid="8e07c583-ff9b-4cd7-938e-d9464fa8b1b8">
Nov 08 20:06:10 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:06:10 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:10 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:10 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:10 user nova-compute[74638]:   </metadata>
Nov 08 20:06:10 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:10 user nova-compute[74638]:     <system>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="serial">10037bd1-d710-4ce1-abe8-b1f5b657c828</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="uuid">10037bd1-d710-4ce1-abe8-b1f5b657c828</entry>
Nov 08 20:06:10 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:10 user nova-compute[74638]:     </system>
Nov 08 20:06:10 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:10 user nova-compute[74638]:   <os>
Nov 08 20:06:10 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:10 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:10 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:10 user nova-compute[74638]:   </os>
Nov 08 20:06:10 user nova-compute[74638]:   <features>
Nov 08 20:06:10 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:10 user nova-compute[74638]:     <apic/>
Nov 08 20:06:10 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:10 user nova-compute[74638]:   </features>
Nov 08 20:06:10 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:10 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:10 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:10 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:10 user nova-compute[74638]:   </clock>
Nov 08 20:06:10 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:10 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:10 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:10 user nova-compute[74638]:   </cpu>
Nov 08 20:06:10 user nova-compute[74638]:   <devices>
Nov 08 20:06:10 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:10 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:10 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk"/>
Nov 08 20:06:10 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:06:10 user nova-compute[74638]:     </disk>
Nov 08 20:06:10 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:10 user nova-compute[74638]:       <mac address="fa:16:3e:32:38:bb"/>
Nov 08 20:06:10 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:10 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:10 user nova-compute[74638]:       <target dev="tap8e07c583-ff"/>
Nov 08 20:06:10 user nova-compute[74638]:     </interface>
Nov 08 20:06:10 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:10 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/console.log" append="off"/>
Nov 08 20:06:10 user nova-compute[74638]:     </serial>
Nov 08 20:06:10 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:10 user nova-compute[74638]:     <video>
Nov 08 20:06:10 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:10 user nova-compute[74638]:     </video>
Nov 08 20:06:10 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:10 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:10 user nova-compute[74638]:     </rng>
Nov 08 20:06:10 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:10 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:10 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:10 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:10 user nova-compute[74638]:   </devices>
Nov 08 20:06:10 user nova-compute[74638]: </domain>
Nov 08 20:06:10 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1387226148',display_name='tempest-ServerActionsTestOtherB-server-1387226148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1387226148',id=3,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8A1RgZiaKFum/883dNVq7J+v3UCm/3/JFR42J7y5Hebbohx5tb1NTPsX/lXcVvbFBbJq0a6gwWQrQVd1WQF6MRsP1YE0d59iTG4w3v32bGJ2E8n6PhHZjT/RrZMTOHQ==',key_name='tempest-keypair-1075117626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da2cebdae35a49a7a6d6fbcf4b0cd1ee',ramdisk_id='',reservation_id='r-u0n8ymi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1698257018',owner_user_name='tempest-ServerActionsTestOtherB-1698257018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db7a353114a446b0a3294508e169cd3f',uuid=10037bd1-d710-4ce1-abe8-b1f5b657c828,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Converting VIF {"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:38:bb,bridge_name='br-int',has_traffic_filtering=True,id=8e07c583-ff9b-4cd7-938e-d9464fa8b1b8,network=Network(677302cb-0b2e-4e58-9adf-5e10929fa6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e07c583-ff') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG os_vif [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:38:bb,bridge_name='br-int',has_traffic_filtering=True,id=8e07c583-ff9b-4cd7-938e-d9464fa8b1b8,network=Network(677302cb-0b2e-4e58-9adf-5e10929fa6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e07c583-ff') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a58ee019-9912-5fbe-ae21-7e26e9750edd', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e07c583-ff, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e07c583-ff, col_values=(('qos', UUID('d0d89ccf-f436-4019-a29a-1a3af590681c')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e07c583-ff, col_values=(('external_ids', {'iface-id': '8e07c583-ff9b-4cd7-938e-d9464fa8b1b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:38:bb', 'vm-uuid': '10037bd1-d710-4ce1-abe8-b1f5b657c828'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:10 user nova-compute[74638]: INFO os_vif [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:38:bb,bridge_name='br-int',has_traffic_filtering=True,id=8e07c583-ff9b-4cd7-938e-d9464fa8b1b8,network=Network(677302cb-0b2e-4e58-9adf-5e10929fa6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e07c583-ff')
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] No VIF found with MAC fa:16:3e:32:38:bb, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Instance spawned successfully.
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Releasing lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Instance network_info: |[{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Start _get_guest_xml network_info=[{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Instance spawned successfully.
Nov 08 20:06:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:11 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:11 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-555026932',display_name='tempest-ServerActionsTestOtherA-server-555026932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-555026932',id=5,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-3vp46ot3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=e13e6fa8-4eac-4077-ba81-b107a1f9bfe0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=fe0448bd-7de8-4903-85a8-e9e452f2fec2,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0448bd-7d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.objects.instance [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'pci_devices' on Instance uuid e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-829ec9ac-5ddf-4cf7-a0ee-d184ea9ca086 req-d80cefea-b621-4095-961f-521122fcf3ed service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updated VIF entry in instance network info cache for port 2dae479f-02ee-40bc-8a5d-436e3931e032. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-829ec9ac-5ddf-4cf7-a0ee-d184ea9ca086 req-d80cefea-b621-4095-961f-521122fcf3ed service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating instance_info_cache with network_info: [{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:11 user nova-compute[74638]:   <uuid>e13e6fa8-4eac-4077-ba81-b107a1f9bfe0</uuid>
Nov 08 20:06:11 user nova-compute[74638]:   <name>instance-00000005</name>
Nov 08 20:06:11 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:11 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:11 user nova-compute[74638]:   <metadata>
Nov 08 20:06:11 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:11 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:11 user nova-compute[74638]:       <nova:name>tempest-ServerActionsTestOtherA-server-555026932</nova:name>
Nov 08 20:06:11 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:11</nova:creationTime>
Nov 08 20:06:11 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:11 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:11 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:11 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:11 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:11 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:11 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:11 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:11 user nova-compute[74638]:         <nova:user uuid="fc302495f45a4ae1bd2524aa60ecbc85">tempest-ServerActionsTestOtherA-1281886616-project-member</nova:user>
Nov 08 20:06:11 user nova-compute[74638]:         <nova:project uuid="4d0b2492206349f197739ee10c95a28f">tempest-ServerActionsTestOtherA-1281886616</nova:project>
Nov 08 20:06:11 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:11 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:06:11 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:11 user nova-compute[74638]:         <nova:port uuid="fe0448bd-7de8-4903-85a8-e9e452f2fec2">
Nov 08 20:06:11 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 20:06:11 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:11 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:11 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:11 user nova-compute[74638]:   </metadata>
Nov 08 20:06:11 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:11 user nova-compute[74638]:     <system>
Nov 08 20:06:11 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:11 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:11 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:11 user nova-compute[74638]:       <entry name="serial">e13e6fa8-4eac-4077-ba81-b107a1f9bfe0</entry>
Nov 08 20:06:11 user nova-compute[74638]:       <entry name="uuid">e13e6fa8-4eac-4077-ba81-b107a1f9bfe0</entry>
Nov 08 20:06:11 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:11 user nova-compute[74638]:     </system>
Nov 08 20:06:11 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:11 user nova-compute[74638]:   <os>
Nov 08 20:06:11 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:11 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:11 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:11 user nova-compute[74638]:   </os>
Nov 08 20:06:11 user nova-compute[74638]:   <features>
Nov 08 20:06:11 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:11 user nova-compute[74638]:     <apic/>
Nov 08 20:06:11 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:11 user nova-compute[74638]:   </features>
Nov 08 20:06:11 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:11 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:11 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:11 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:11 user nova-compute[74638]:   </clock>
Nov 08 20:06:11 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:11 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:11 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:11 user nova-compute[74638]:   </cpu>
Nov 08 20:06:11 user nova-compute[74638]:   <devices>
Nov 08 20:06:11 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:11 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:11 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk"/>
Nov 08 20:06:11 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:06:11 user nova-compute[74638]:     </disk>
Nov 08 20:06:11 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:11 user nova-compute[74638]:       <mac address="fa:16:3e:6f:c0:81"/>
Nov 08 20:06:11 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:11 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:11 user nova-compute[74638]:       <target dev="tapfe0448bd-7d"/>
Nov 08 20:06:11 user nova-compute[74638]:     </interface>
Nov 08 20:06:11 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:11 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/console.log" append="off"/>
Nov 08 20:06:11 user nova-compute[74638]:     </serial>
Nov 08 20:06:11 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:11 user nova-compute[74638]:     <video>
Nov 08 20:06:11 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:11 user nova-compute[74638]:     </video>
Nov 08 20:06:11 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:11 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:11 user nova-compute[74638]:     </rng>
Nov 08 20:06:11 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:11 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:11 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:11 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:11 user nova-compute[74638]:   </devices>
Nov 08 20:06:11 user nova-compute[74638]: </domain>
Nov 08 20:06:11 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-555026932',display_name='tempest-ServerActionsTestOtherA-server-555026932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-555026932',id=5,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-3vp46ot3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=e13e6fa8-4eac-4077-ba81-b107a1f9bfe0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=fe0448bd-7de8-4903-85a8-e9e452f2fec2,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0448bd-7d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG os_vif [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=fe0448bd-7de8-4903-85a8-e9e452f2fec2,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0448bd-7d') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f974ec4-a10e-5d83-8725-cf3df38acf18', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:11 user nova-compute[74638]: INFO nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Took 14.79 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-829ec9ac-5ddf-4cf7-a0ee-d184ea9ca086 req-d80cefea-b621-4095-961f-521122fcf3ed service nova] Releasing lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe0448bd-7d, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe0448bd-7d, col_values=(('qos', UUID('c60aab7c-f77f-41e6-a307-627bd008cd6b')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe0448bd-7d, col_values=(('external_ids', {'iface-id': 'fe0448bd-7de8-4903-85a8-e9e452f2fec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:c0:81', 'vm-uuid': 'e13e6fa8-4eac-4077-ba81-b107a1f9bfe0'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-95be03d6-de83-4b66-b0f8-3d9d53b92062 req-f0c6f8c6-1242-4e3a-b880-116640c77798 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-changed-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-95be03d6-de83-4b66-b0f8-3d9d53b92062 req-f0c6f8c6-1242-4e3a-b880-116640c77798 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Refreshing instance network info cache due to event network-changed-fe0448bd-7de8-4903-85a8-e9e452f2fec2. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-95be03d6-de83-4b66-b0f8-3d9d53b92062 req-f0c6f8c6-1242-4e3a-b880-116640c77798 service nova] Acquiring lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-95be03d6-de83-4b66-b0f8-3d9d53b92062 req-f0c6f8c6-1242-4e3a-b880-116640c77798 service nova] Acquired lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-95be03d6-de83-4b66-b0f8-3d9d53b92062 req-f0c6f8c6-1242-4e3a-b880-116640c77798 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Refreshing network info cache for port fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:11 user nova-compute[74638]: INFO os_vif [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=fe0448bd-7de8-4903-85a8-e9e452f2fec2,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0448bd-7d')
Nov 08 20:06:11 user nova-compute[74638]: INFO nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Took 10.38 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:11 user nova-compute[74638]: INFO nova.compute.manager [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Took 15.89 seconds to build instance.
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No VIF found with MAC fa:16:3e:6f:c0:81, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-501d7694-1c88-44bf-a56c-86f83704c012 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.451s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:11 user nova-compute[74638]: INFO nova.compute.manager [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Took 11.73 seconds to build instance.
Nov 08 20:06:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-709c72b4-f1aa-45e8-9611-173041f35307 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.922s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:12 user nova-compute[74638]: DEBUG nova.network.neutron [req-95be03d6-de83-4b66-b0f8-3d9d53b92062 req-f0c6f8c6-1242-4e3a-b880-116640c77798 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updated VIF entry in instance network info cache for port fe0448bd-7de8-4903-85a8-e9e452f2fec2. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:06:12 user nova-compute[74638]: DEBUG nova.network.neutron [req-95be03d6-de83-4b66-b0f8-3d9d53b92062 req-f0c6f8c6-1242-4e3a-b880-116640c77798 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-95be03d6-de83-4b66-b0f8-3d9d53b92062 req-f0c6f8c6-1242-4e3a-b880-116640c77798 service nova] Releasing lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-9f7c4bc6-a3f8-46f9-9552-0f69bbf7da6e req-1dc9e023-2a26-4272-b881-ab47d5b9acb7 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updated VIF entry in instance network info cache for port 8e07c583-ff9b-4cd7-938e-d9464fa8b1b8. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:06:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-9f7c4bc6-a3f8-46f9-9552-0f69bbf7da6e req-1dc9e023-2a26-4272-b881-ab47d5b9acb7 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updating instance_info_cache with network_info: [{"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9f7c4bc6-a3f8-46f9-9552-0f69bbf7da6e req-1dc9e023-2a26-4272-b881-ab47d5b9acb7 service nova] Releasing lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Instance spawned successfully.
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance spawned successfully.
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Took 16.35 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Instance spawned successfully.
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Took 14.55 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.compute.manager [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Took 17.15 seconds to build instance.
Nov 08 20:06:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0835a3ea-7749-4b32-8c2b-de6eeb2685a7 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.523s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Took 13.98 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.compute.manager [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Took 16.14 seconds to build instance.
Nov 08 20:06:19 user nova-compute[74638]: INFO nova.compute.manager [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Took 15.11 seconds to build instance.
Nov 08 20:06:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a7e1024-2aa8-4f33-ae31-4a1e83eb0bb6 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.331s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-29377f8d-01c9-4798-b62a-8af8560d0ab6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.258s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-be3c9ae9-a076-45c3-8a4f-58f5734f635b req-a8bb5cd9-49c1-4623-b6bd-9b9216107acd service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received event network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-be3c9ae9-a076-45c3-8a4f-58f5734f635b req-a8bb5cd9-49c1-4623-b6bd-9b9216107acd service nova] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-be3c9ae9-a076-45c3-8a4f-58f5734f635b req-a8bb5cd9-49c1-4623-b6bd-9b9216107acd service nova] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-be3c9ae9-a076-45c3-8a4f-58f5734f635b req-a8bb5cd9-49c1-4623-b6bd-9b9216107acd service nova] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-be3c9ae9-a076-45c3-8a4f-58f5734f635b req-a8bb5cd9-49c1-4623-b6bd-9b9216107acd service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] No waiting events found dispatching network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:20 user nova-compute[74638]: WARNING nova.compute.manager [req-be3c9ae9-a076-45c3-8a4f-58f5734f635b req-a8bb5cd9-49c1-4623-b6bd-9b9216107acd service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received unexpected event network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 for instance with vm_state active and task_state None.
Nov 08 20:06:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-120ef652-092d-4e22-a40b-8f3668b267dd req-8c1a3650-a6a0-490d-b72b-3129f29598ef service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received event network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-120ef652-092d-4e22-a40b-8f3668b267dd req-8c1a3650-a6a0-490d-b72b-3129f29598ef service nova] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-120ef652-092d-4e22-a40b-8f3668b267dd req-8c1a3650-a6a0-490d-b72b-3129f29598ef service nova] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-120ef652-092d-4e22-a40b-8f3668b267dd req-8c1a3650-a6a0-490d-b72b-3129f29598ef service nova] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-120ef652-092d-4e22-a40b-8f3668b267dd req-8c1a3650-a6a0-490d-b72b-3129f29598ef service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] No waiting events found dispatching network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:21 user nova-compute[74638]: WARNING nova.compute.manager [req-120ef652-092d-4e22-a40b-8f3668b267dd req-8c1a3650-a6a0-490d-b72b-3129f29598ef service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received unexpected event network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 for instance with vm_state active and task_state None.
Nov 08 20:06:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-792c3360-2f86-4815-9615-0bc6e78aecef req-d93d31b4-4eb3-45f9-a5ec-06bee30c7bd9 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received event network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-792c3360-2f86-4815-9615-0bc6e78aecef req-d93d31b4-4eb3-45f9-a5ec-06bee30c7bd9 service nova] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-792c3360-2f86-4815-9615-0bc6e78aecef req-d93d31b4-4eb3-45f9-a5ec-06bee30c7bd9 service nova] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-792c3360-2f86-4815-9615-0bc6e78aecef req-d93d31b4-4eb3-45f9-a5ec-06bee30c7bd9 service nova] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-792c3360-2f86-4815-9615-0bc6e78aecef req-d93d31b4-4eb3-45f9-a5ec-06bee30c7bd9 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] No waiting events found dispatching network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:22 user nova-compute[74638]: WARNING nova.compute.manager [req-792c3360-2f86-4815-9615-0bc6e78aecef req-d93d31b4-4eb3-45f9-a5ec-06bee30c7bd9 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received unexpected event network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 for instance with vm_state active and task_state None.
Nov 08 20:06:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received event network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] No waiting events found dispatching network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:23 user nova-compute[74638]: WARNING nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received unexpected event network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 for instance with vm_state active and task_state None.
Nov 08 20:06:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received event network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Acquiring lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] No waiting events found dispatching network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:23 user nova-compute[74638]: WARNING nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received unexpected event network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b for instance with vm_state active and task_state None.
Nov 08 20:06:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received event network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Acquiring lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] No waiting events found dispatching network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:23 user nova-compute[74638]: WARNING nova.compute.manager [req-46001d16-b9bc-4a3c-a109-33fb9b86ad07 req-307b5436-af38-440e-9fa8-64b588f80b1d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received unexpected event network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b for instance with vm_state active and task_state None.
Nov 08 20:06:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:29 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:06:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:06:29 user nova-compute[74638]: INFO nova.compute.claims [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Claim successful on node user
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.112s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:06:30 user nova-compute[74638]: INFO nova.compute.claims [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Claim successful on node user
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:06:30 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.policy [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41550eb95068416b92ec47d447f66ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc41c3a21fb34b82a66eaa4c3ebf293b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:06:30 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Creating image(s)
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "/opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "/opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "6c9db9b9004e535c14a97d90eb537720e111a5c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "6c9db9b9004e535c14a97d90eb537720e111a5c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.146s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0.part --force-share --output=json" returned: 0 in 0.304s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.virt.images [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] 62705185-baaf-4bc0-be1f-f41ca9556849 was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0.part /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:31 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.policy [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be705289f5974554ab1d6bc4e66735b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f180c62c64dcb83c30c7e3e8a5c4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0.part /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0.converted" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Successfully created port: 786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:06:32 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Creating image(s)
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0.converted --force-share --output=json" returned: 0 in 0.291s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "6c9db9b9004e535c14a97d90eb537720e111a5c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.351s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.291s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0 --force-share --output=json" returned: 0 in 0.250s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "6c9db9b9004e535c14a97d90eb537720e111a5c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "6c9db9b9004e535c14a97d90eb537720e111a5c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.222s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk 1073741824" returned: 0 in 0.070s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0 --force-share --output=json" returned: 0 in 0.292s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0,backing_fmt=raw /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0,backing_fmt=raw /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk 1073741824" returned: 0 in 0.060s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "6c9db9b9004e535c14a97d90eb537720e111a5c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.254s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.neutron [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Successfully created port: 18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Successfully updated port: 786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0 --force-share --output=json" returned: 0 in 0.238s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquired lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-7451aaf2-9222-437e-bb27-ab2f1afb1585 req-b796ef32-8009-4cf3-bda2-3858b57242a1 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received event network-changed-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-7451aaf2-9222-437e-bb27-ab2f1afb1585 req-b796ef32-8009-4cf3-bda2-3858b57242a1 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Refreshing instance network info cache due to event network-changed-786b38d9-2eb5-4dff-9c4a-0776f304a821. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7451aaf2-9222-437e-bb27-ab2f1afb1585 req-b796ef32-8009-4cf3-bda2-3858b57242a1 service nova] Acquiring lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Cannot resize image /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Ensure instance console log exists: /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Cannot resize image /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Ensure instance console log exists: /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Updating instance_info_cache with network_info: [{"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Releasing lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Instance network_info: |[{"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7451aaf2-9222-437e-bb27-ab2f1afb1585 req-b796ef32-8009-4cf3-bda2-3858b57242a1 service nova] Acquired lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.neutron [req-7451aaf2-9222-437e-bb27-ab2f1afb1585 req-b796ef32-8009-4cf3-bda2-3858b57242a1 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Refreshing network info cache for port 786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Start _get_guest_xml network_info=[{"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:06:17Z,direct_url=<?>,disk_format='qcow2',id=62705185-baaf-4bc0-be1f-f41ca9556849,min_disk=0,min_ram=0,name='',owner='dbfa079c586c48ac82610eb77c603707',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:06:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/sda', 'guest_format': None, 'disk_bus': 'scsi', 'image_id': '62705185-baaf-4bc0-be1f-f41ca9556849'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:06:17Z,direct_url=<?>,disk_format='qcow2',id=62705185-baaf-4bc0-be1f-f41ca9556849,min_disk=0,min_ram=0,name='',owner='dbfa079c586c48ac82610eb77c603707',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:06:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-772174861',display_name='tempest-AttachSCSIVolumeTestJSON-server-772174861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-772174861',id=6,image_ref='62705185-baaf-4bc0-be1f-f41ca9556849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7MilvXEUJ548Dmtqd44r3GHIsZp/g7rAszmwMNkiWeCHGHUfwDDCiXwUZa8valesB2bN49hhgQArJF3ck5vlZSokI3cU9amOY9PkQ8fdT9odXjsh4Ha7QA66qCC55/aQ==',key_name='tempest-keypair-372527692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc41c3a21fb34b82a66eaa4c3ebf293b',ramdisk_id='',reservation_id='r-c0bhnoev',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62705185-baaf-4bc0-be1f-f41ca9556849',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-922557478',owner_user_name='tempest-AttachSCSIVolumeTestJSON-922557478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41550eb95068416b92ec47d447f66ff6',uuid=e8daf0a9-b049-4dad-8128-cb34cf241da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Converting VIF {"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:dd:ab,bridge_name='br-int',has_traffic_filtering=True,id=786b38d9-2eb5-4dff-9c4a-0776f304a821,network=Network(e75879e5-faba-4f9f-a527-4e0b4010a580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap786b38d9-2e') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lazy-loading 'pci_devices' on Instance uuid e8daf0a9-b049-4dad-8128-cb34cf241da3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:33 user nova-compute[74638]:   <uuid>e8daf0a9-b049-4dad-8128-cb34cf241da3</uuid>
Nov 08 20:06:33 user nova-compute[74638]:   <name>instance-00000006</name>
Nov 08 20:06:33 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:33 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:33 user nova-compute[74638]:   <metadata>
Nov 08 20:06:33 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:33 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:33 user nova-compute[74638]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-772174861</nova:name>
Nov 08 20:06:33 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:33</nova:creationTime>
Nov 08 20:06:33 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:33 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:33 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:33 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:33 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:33 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:33 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:33 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:33 user nova-compute[74638]:         <nova:user uuid="41550eb95068416b92ec47d447f66ff6">tempest-AttachSCSIVolumeTestJSON-922557478-project-member</nova:user>
Nov 08 20:06:33 user nova-compute[74638]:         <nova:project uuid="bc41c3a21fb34b82a66eaa4c3ebf293b">tempest-AttachSCSIVolumeTestJSON-922557478</nova:project>
Nov 08 20:06:33 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:33 user nova-compute[74638]:       <nova:root type="image" uuid="62705185-baaf-4bc0-be1f-f41ca9556849"/>
Nov 08 20:06:33 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:33 user nova-compute[74638]:         <nova:port uuid="786b38d9-2eb5-4dff-9c4a-0776f304a821">
Nov 08 20:06:33 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 20:06:33 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:33 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:33 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:33 user nova-compute[74638]:   </metadata>
Nov 08 20:06:33 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:33 user nova-compute[74638]:     <system>
Nov 08 20:06:33 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:33 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:33 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:33 user nova-compute[74638]:       <entry name="serial">e8daf0a9-b049-4dad-8128-cb34cf241da3</entry>
Nov 08 20:06:33 user nova-compute[74638]:       <entry name="uuid">e8daf0a9-b049-4dad-8128-cb34cf241da3</entry>
Nov 08 20:06:33 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:33 user nova-compute[74638]:     </system>
Nov 08 20:06:33 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:33 user nova-compute[74638]:   <os>
Nov 08 20:06:33 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:33 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:33 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:33 user nova-compute[74638]:   </os>
Nov 08 20:06:33 user nova-compute[74638]:   <features>
Nov 08 20:06:33 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:33 user nova-compute[74638]:     <apic/>
Nov 08 20:06:33 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:33 user nova-compute[74638]:   </features>
Nov 08 20:06:33 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:33 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:33 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:33 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:33 user nova-compute[74638]:   </clock>
Nov 08 20:06:33 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:33 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:33 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:33 user nova-compute[74638]:   </cpu>
Nov 08 20:06:33 user nova-compute[74638]:   <devices>
Nov 08 20:06:33 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:33 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:33 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk"/>
Nov 08 20:06:33 user nova-compute[74638]:       <target dev="sda" bus="scsi"/>
Nov 08 20:06:33 user nova-compute[74638]:       <address type="drive" controller="0" unit="0"/>
Nov 08 20:06:33 user nova-compute[74638]:     </disk>
Nov 08 20:06:33 user nova-compute[74638]:     <disk type="file" device="cdrom">
Nov 08 20:06:33 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 20:06:33 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk.config"/>
Nov 08 20:06:33 user nova-compute[74638]:       <target dev="sdb" bus="scsi"/>
Nov 08 20:06:33 user nova-compute[74638]:       <address type="drive" controller="0" unit="1"/>
Nov 08 20:06:33 user nova-compute[74638]:     </disk>
Nov 08 20:06:33 user nova-compute[74638]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 20:06:33 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:33 user nova-compute[74638]:       <mac address="fa:16:3e:54:dd:ab"/>
Nov 08 20:06:33 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:33 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:33 user nova-compute[74638]:       <target dev="tap786b38d9-2e"/>
Nov 08 20:06:33 user nova-compute[74638]:     </interface>
Nov 08 20:06:33 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:33 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/console.log" append="off"/>
Nov 08 20:06:33 user nova-compute[74638]:     </serial>
Nov 08 20:06:33 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:33 user nova-compute[74638]:     <video>
Nov 08 20:06:33 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:33 user nova-compute[74638]:     </video>
Nov 08 20:06:33 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:33 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:33 user nova-compute[74638]:     </rng>
Nov 08 20:06:33 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:33 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:33 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:33 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:33 user nova-compute[74638]:   </devices>
Nov 08 20:06:33 user nova-compute[74638]: </domain>
Nov 08 20:06:33 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-772174861',display_name='tempest-AttachSCSIVolumeTestJSON-server-772174861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-772174861',id=6,image_ref='62705185-baaf-4bc0-be1f-f41ca9556849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7MilvXEUJ548Dmtqd44r3GHIsZp/g7rAszmwMNkiWeCHGHUfwDDCiXwUZa8valesB2bN49hhgQArJF3ck5vlZSokI3cU9amOY9PkQ8fdT9odXjsh4Ha7QA66qCC55/aQ==',key_name='tempest-keypair-372527692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc41c3a21fb34b82a66eaa4c3ebf293b',ramdisk_id='',reservation_id='r-c0bhnoev',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62705185-baaf-4bc0-be1f-f41ca9556849',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-922557478',owner_user_name='tempest-AttachSCSIVolumeTestJSON-922557478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41550eb95068416b92ec47d447f66ff6',uuid=e8daf0a9-b049-4dad-8128-cb34cf241da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Converting VIF {"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:dd:ab,bridge_name='br-int',has_traffic_filtering=True,id=786b38d9-2eb5-4dff-9c4a-0776f304a821,network=Network(e75879e5-faba-4f9f-a527-4e0b4010a580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap786b38d9-2e') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG os_vif [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:dd:ab,bridge_name='br-int',has_traffic_filtering=True,id=786b38d9-2eb5-4dff-9c4a-0776f304a821,network=Network(e75879e5-faba-4f9f-a527-4e0b4010a580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap786b38d9-2e') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '215f9355-d8f1-562b-89be-f04cf181afcb', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap786b38d9-2e, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap786b38d9-2e, col_values=(('qos', UUID('de5d7d4b-65cc-41a6-95ad-e75c59ebaf5f')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap786b38d9-2e, col_values=(('external_ids', {'iface-id': '786b38d9-2eb5-4dff-9c4a-0776f304a821', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:dd:ab', 'vm-uuid': 'e8daf0a9-b049-4dad-8128-cb34cf241da3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:33 user nova-compute[74638]: INFO os_vif [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:dd:ab,bridge_name='br-int',has_traffic_filtering=True,id=786b38d9-2eb5-4dff-9c4a-0776f304a821,network=Network(e75879e5-faba-4f9f-a527-4e0b4010a580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap786b38d9-2e')
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] No BDM found with device name sda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] No VIF found with MAC fa:16:3e:54:dd:ab, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Using config drive
Nov 08 20:06:34 user nova-compute[74638]: DEBUG nova.network.neutron [req-7451aaf2-9222-437e-bb27-ab2f1afb1585 req-b796ef32-8009-4cf3-bda2-3858b57242a1 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Updated VIF entry in instance network info cache for port 786b38d9-2eb5-4dff-9c4a-0776f304a821. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG nova.network.neutron [req-7451aaf2-9222-437e-bb27-ab2f1afb1585 req-b796ef32-8009-4cf3-bda2-3858b57242a1 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Updating instance_info_cache with network_info: [{"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7451aaf2-9222-437e-bb27-ab2f1afb1585 req-b796ef32-8009-4cf3-bda2-3858b57242a1 service nova] Releasing lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Creating config drive at /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk.config
Nov 08 20:06:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmvndc_v7 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Successfully updated port: 18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquired lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmvndc_v7" returned: 0 in 0.080s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-aecacdba-878b-4df9-9bbf-079d1931a0d8 req-4f596303-6579-477c-941e-a7e8834d5951 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-changed-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-aecacdba-878b-4df9-9bbf-079d1931a0d8 req-4f596303-6579-477c-941e-a7e8834d5951 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Refreshing instance network info cache due to event network-changed-18e2eb15-f699-42ac-ac84-e6d446f1f59c. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aecacdba-878b-4df9-9bbf-079d1931a0d8 req-4f596303-6579-477c-941e-a7e8834d5951 service nova] Acquiring lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating instance_info_cache with network_info: [{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Releasing lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Instance network_info: |[{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aecacdba-878b-4df9-9bbf-079d1931a0d8 req-4f596303-6579-477c-941e-a7e8834d5951 service nova] Acquired lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-aecacdba-878b-4df9-9bbf-079d1931a0d8 req-4f596303-6579-477c-941e-a7e8834d5951 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Refreshing network info cache for port 18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Start _get_guest_xml network_info=[{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:35 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:35 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converting VIF {"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:67:68,bridge_name='br-int',has_traffic_filtering=True,id=18e2eb15-f699-42ac-ac84-e6d446f1f59c,network=Network(0a22ac6f-9ea5-4bfc-8abc-aacfd4772510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e2eb15-f6') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lazy-loading 'pci_devices' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:35 user nova-compute[74638]:   <uuid>b2192b24-bca8-467c-b408-f6f645d5557f</uuid>
Nov 08 20:06:35 user nova-compute[74638]:   <name>instance-00000007</name>
Nov 08 20:06:35 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:35 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:35 user nova-compute[74638]:   <metadata>
Nov 08 20:06:35 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:35 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:35 user nova-compute[74638]:       <nova:name>tempest-device-tagging-server-1887474706</nova:name>
Nov 08 20:06:35 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:35</nova:creationTime>
Nov 08 20:06:35 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:35 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:35 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:35 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:35 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:35 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:35 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:35 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:35 user nova-compute[74638]:         <nova:user uuid="be705289f5974554ab1d6bc4e66735b5">tempest-TaggedAttachmentsTest-929214679-project-member</nova:user>
Nov 08 20:06:35 user nova-compute[74638]:         <nova:project uuid="f83f180c62c64dcb83c30c7e3e8a5c4e">tempest-TaggedAttachmentsTest-929214679</nova:project>
Nov 08 20:06:35 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:35 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:06:35 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:35 user nova-compute[74638]:         <nova:port uuid="18e2eb15-f699-42ac-ac84-e6d446f1f59c">
Nov 08 20:06:35 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:06:35 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:35 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:35 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:35 user nova-compute[74638]:   </metadata>
Nov 08 20:06:35 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:35 user nova-compute[74638]:     <system>
Nov 08 20:06:35 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:35 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:35 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:35 user nova-compute[74638]:       <entry name="serial">b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:06:35 user nova-compute[74638]:       <entry name="uuid">b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:06:35 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:35 user nova-compute[74638]:     </system>
Nov 08 20:06:35 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:35 user nova-compute[74638]:   <os>
Nov 08 20:06:35 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:35 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:35 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:35 user nova-compute[74638]:   </os>
Nov 08 20:06:35 user nova-compute[74638]:   <features>
Nov 08 20:06:35 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:35 user nova-compute[74638]:     <apic/>
Nov 08 20:06:35 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:35 user nova-compute[74638]:   </features>
Nov 08 20:06:35 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:35 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:35 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:35 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:35 user nova-compute[74638]:   </clock>
Nov 08 20:06:35 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:35 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:35 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:35 user nova-compute[74638]:   </cpu>
Nov 08 20:06:35 user nova-compute[74638]:   <devices>
Nov 08 20:06:35 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:35 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:35 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk"/>
Nov 08 20:06:35 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:06:35 user nova-compute[74638]:     </disk>
Nov 08 20:06:35 user nova-compute[74638]:     <disk type="file" device="cdrom">
Nov 08 20:06:35 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 20:06:35 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.config"/>
Nov 08 20:06:35 user nova-compute[74638]:       <target dev="hda" bus="ide"/>
Nov 08 20:06:35 user nova-compute[74638]:     </disk>
Nov 08 20:06:35 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:35 user nova-compute[74638]:       <mac address="fa:16:3e:a8:67:68"/>
Nov 08 20:06:35 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:35 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:35 user nova-compute[74638]:       <target dev="tap18e2eb15-f6"/>
Nov 08 20:06:35 user nova-compute[74638]:     </interface>
Nov 08 20:06:35 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:35 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log" append="off"/>
Nov 08 20:06:35 user nova-compute[74638]:     </serial>
Nov 08 20:06:35 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:35 user nova-compute[74638]:     <video>
Nov 08 20:06:35 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:35 user nova-compute[74638]:     </video>
Nov 08 20:06:35 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:35 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:35 user nova-compute[74638]:     </rng>
Nov 08 20:06:35 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:35 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:35 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:35 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:35 user nova-compute[74638]:   </devices>
Nov 08 20:06:35 user nova-compute[74638]: </domain>
Nov 08 20:06:35 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converting VIF {"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:67:68,bridge_name='br-int',has_traffic_filtering=True,id=18e2eb15-f699-42ac-ac84-e6d446f1f59c,network=Network(0a22ac6f-9ea5-4bfc-8abc-aacfd4772510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e2eb15-f6') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG os_vif [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:67:68,bridge_name='br-int',has_traffic_filtering=True,id=18e2eb15-f699-42ac-ac84-e6d446f1f59c,network=Network(0a22ac6f-9ea5-4bfc-8abc-aacfd4772510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e2eb15-f6') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0229551-ecf9-52a8-8ce2-58cedba54e33', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18e2eb15-f6, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18e2eb15-f6, col_values=(('qos', UUID('d40ba06f-7847-4d2e-a43d-2ce5bee0d758')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18e2eb15-f6, col_values=(('external_ids', {'iface-id': '18e2eb15-f699-42ac-ac84-e6d446f1f59c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:67:68', 'vm-uuid': 'b2192b24-bca8-467c-b408-f6f645d5557f'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:35 user nova-compute[74638]: INFO os_vif [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:67:68,bridge_name='br-int',has_traffic_filtering=True,id=18e2eb15-f699-42ac-ac84-e6d446f1f59c,network=Network(0a22ac6f-9ea5-4bfc-8abc-aacfd4772510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e2eb15-f6')
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No BDM found with device name hda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No VIF found with MAC fa:16:3e:a8:67:68, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Using config drive
Nov 08 20:06:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Creating config drive at /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.config
Nov 08 20:06:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp639p1lct {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp639p1lct" returned: 0 in 0.068s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-aecacdba-878b-4df9-9bbf-079d1931a0d8 req-4f596303-6579-477c-941e-a7e8834d5951 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updated VIF entry in instance network info cache for port 18e2eb15-f699-42ac-ac84-e6d446f1f59c. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-aecacdba-878b-4df9-9bbf-079d1931a0d8 req-4f596303-6579-477c-941e-a7e8834d5951 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating instance_info_cache with network_info: [{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aecacdba-878b-4df9-9bbf-079d1931a0d8 req-4f596303-6579-477c-941e-a7e8834d5951 service nova] Releasing lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:06:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:06:39 user nova-compute[74638]: INFO nova.compute.claims [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Claim successful on node user
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:06:39 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.policy [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f198734797a94f8ebda2f3cec7655c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f472295181a4bb88d49b2a73d2e60b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:06:39 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Creating image(s)
Nov 08 20:06:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "/opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "/opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "/opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk 1073741824" returned: 0 in 0.059s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.236s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Instance spawned successfully.
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Instance spawned successfully.
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:40 user nova-compute[74638]: INFO nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Took 9.94 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Cannot resize image /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Ensure instance console log exists: /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Successfully created port: e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:06:40 user nova-compute[74638]: INFO nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Took 8.74 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:40 user nova-compute[74638]: INFO nova.compute.manager [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Took 11.14 seconds to build instance.
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1316be1d-bf31-49a3-aaa8-23e7666cfa95 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.343s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:40 user nova-compute[74638]: INFO nova.compute.manager [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Took 10.64 seconds to build instance.
Nov 08 20:06:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65145c07-14b9-4de5-a50a-53df1aa35cd8 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.796s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Successfully updated port: e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-cd76129d-abbf-4d7c-a94d-892565fefa4b req-fa907f57-550f-43d4-a0e3-8bccd1ad19a8 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Received event network-changed-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-cd76129d-abbf-4d7c-a94d-892565fefa4b req-fa907f57-550f-43d4-a0e3-8bccd1ad19a8 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Refreshing instance network info cache due to event network-changed-e4be2549-2cdf-4d34-a56f-3ec27579c1c1. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd76129d-abbf-4d7c-a94d-892565fefa4b req-fa907f57-550f-43d4-a0e3-8bccd1ad19a8 service nova] Acquiring lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd76129d-abbf-4d7c-a94d-892565fefa4b req-fa907f57-550f-43d4-a0e3-8bccd1ad19a8 service nova] Acquired lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-cd76129d-abbf-4d7c-a94d-892565fefa4b req-fa907f57-550f-43d4-a0e3-8bccd1ad19a8 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Refreshing network info cache for port e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-cd76129d-abbf-4d7c-a94d-892565fefa4b req-fa907f57-550f-43d4-a0e3-8bccd1ad19a8 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-cd76129d-abbf-4d7c-a94d-892565fefa4b req-fa907f57-550f-43d4-a0e3-8bccd1ad19a8 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd76129d-abbf-4d7c-a94d-892565fefa4b req-fa907f57-550f-43d4-a0e3-8bccd1ad19a8 service nova] Releasing lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquired lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:06:41 user nova-compute[74638]: INFO nova.compute.claims [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Claim successful on node user
Nov 08 20:06:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updating instance_info_cache with network_info: [{"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Releasing lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Instance network_info: |[{"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Start _get_guest_xml network_info=[{"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:42 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:42 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-829303057',display_name='tempest-TestVolumeSwap-server-829303057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-829303057',id=8,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc+XkTviaaoAEGe1ENFZkAW+oJRv3HgL2CV3sj1kAcXXqlPdWQTOa08CS1KxAvM6gutQ6w7FlXgok1d/Vnx8MFknNJnAfdXkAThHDP4I2T9o4dVO1OuLoS4VT03fLb35w==',key_name='tempest-keypair-1031493326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f472295181a4bb88d49b2a73d2e60b3',ramdisk_id='',reservation_id='r-ncb65h8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-541036512',owner_user_name='tempest-TestVolumeSwap-541036512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f198734797a94f8ebda2f3cec7655c61',uuid=24b78656-ca13-42c8-b45c-e0c1526c1fee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Converting VIF {"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=e4be2549-2cdf-4d34-a56f-3ec27579c1c1,network=Network(536d14af-a7b4-4197-82d0-568598cfe963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4be2549-2c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lazy-loading 'pci_devices' on Instance uuid 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:42 user nova-compute[74638]:   <uuid>24b78656-ca13-42c8-b45c-e0c1526c1fee</uuid>
Nov 08 20:06:42 user nova-compute[74638]:   <name>instance-00000008</name>
Nov 08 20:06:42 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:42 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:42 user nova-compute[74638]:   <metadata>
Nov 08 20:06:42 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:42 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:42 user nova-compute[74638]:       <nova:name>tempest-TestVolumeSwap-server-829303057</nova:name>
Nov 08 20:06:42 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:42</nova:creationTime>
Nov 08 20:06:42 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:42 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:42 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:42 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:42 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:42 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:42 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:42 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:42 user nova-compute[74638]:         <nova:user uuid="f198734797a94f8ebda2f3cec7655c61">tempest-TestVolumeSwap-541036512-project-member</nova:user>
Nov 08 20:06:42 user nova-compute[74638]:         <nova:project uuid="9f472295181a4bb88d49b2a73d2e60b3">tempest-TestVolumeSwap-541036512</nova:project>
Nov 08 20:06:42 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:42 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:06:42 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:42 user nova-compute[74638]:         <nova:port uuid="e4be2549-2cdf-4d34-a56f-3ec27579c1c1">
Nov 08 20:06:42 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 20:06:42 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:42 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:42 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:42 user nova-compute[74638]:   </metadata>
Nov 08 20:06:42 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:42 user nova-compute[74638]:     <system>
Nov 08 20:06:42 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:42 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:42 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:42 user nova-compute[74638]:       <entry name="serial">24b78656-ca13-42c8-b45c-e0c1526c1fee</entry>
Nov 08 20:06:42 user nova-compute[74638]:       <entry name="uuid">24b78656-ca13-42c8-b45c-e0c1526c1fee</entry>
Nov 08 20:06:42 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:42 user nova-compute[74638]:     </system>
Nov 08 20:06:42 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:42 user nova-compute[74638]:   <os>
Nov 08 20:06:42 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:42 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:42 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:42 user nova-compute[74638]:   </os>
Nov 08 20:06:42 user nova-compute[74638]:   <features>
Nov 08 20:06:42 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:42 user nova-compute[74638]:     <apic/>
Nov 08 20:06:42 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:42 user nova-compute[74638]:   </features>
Nov 08 20:06:42 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:42 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:42 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:42 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:42 user nova-compute[74638]:   </clock>
Nov 08 20:06:42 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:42 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:42 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:42 user nova-compute[74638]:   </cpu>
Nov 08 20:06:42 user nova-compute[74638]:   <devices>
Nov 08 20:06:42 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:42 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:42 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk"/>
Nov 08 20:06:42 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:06:42 user nova-compute[74638]:     </disk>
Nov 08 20:06:42 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:42 user nova-compute[74638]:       <mac address="fa:16:3e:dc:97:0f"/>
Nov 08 20:06:42 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:42 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:42 user nova-compute[74638]:       <target dev="tape4be2549-2c"/>
Nov 08 20:06:42 user nova-compute[74638]:     </interface>
Nov 08 20:06:42 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:42 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/console.log" append="off"/>
Nov 08 20:06:42 user nova-compute[74638]:     </serial>
Nov 08 20:06:42 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:42 user nova-compute[74638]:     <video>
Nov 08 20:06:42 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:42 user nova-compute[74638]:     </video>
Nov 08 20:06:42 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:42 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:42 user nova-compute[74638]:     </rng>
Nov 08 20:06:42 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:42 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:42 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:42 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:42 user nova-compute[74638]:   </devices>
Nov 08 20:06:42 user nova-compute[74638]: </domain>
Nov 08 20:06:42 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-829303057',display_name='tempest-TestVolumeSwap-server-829303057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-829303057',id=8,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc+XkTviaaoAEGe1ENFZkAW+oJRv3HgL2CV3sj1kAcXXqlPdWQTOa08CS1KxAvM6gutQ6w7FlXgok1d/Vnx8MFknNJnAfdXkAThHDP4I2T9o4dVO1OuLoS4VT03fLb35w==',key_name='tempest-keypair-1031493326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f472295181a4bb88d49b2a73d2e60b3',ramdisk_id='',reservation_id='r-ncb65h8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-541036512',owner_user_name='tempest-TestVolumeSwap-541036512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f198734797a94f8ebda2f3cec7655c61',uuid=24b78656-ca13-42c8-b45c-e0c1526c1fee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Converting VIF {"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=e4be2549-2cdf-4d34-a56f-3ec27579c1c1,network=Network(536d14af-a7b4-4197-82d0-568598cfe963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4be2549-2c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG os_vif [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=e4be2549-2cdf-4d34-a56f-3ec27579c1c1,network=Network(536d14af-a7b4-4197-82d0-568598cfe963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4be2549-2c') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0563cdfe-c9ce-5ae8-b785-33dd1939da86', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4be2549-2c, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4be2549-2c, col_values=(('qos', UUID('b64d13b3-6db7-464a-844c-74946514cfce')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4be2549-2c, col_values=(('external_ids', {'iface-id': 'e4be2549-2cdf-4d34-a56f-3ec27579c1c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:97:0f', 'vm-uuid': '24b78656-ca13-42c8-b45c-e0c1526c1fee'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:42 user nova-compute[74638]: INFO os_vif [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=e4be2549-2cdf-4d34-a56f-3ec27579c1c1,network=Network(536d14af-a7b4-4197-82d0-568598cfe963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4be2549-2c')
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.policy [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6f6f6751f3748edb79062052cab2b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb598f0e209b4d56b65c1d505983dfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] No VIF found with MAC fa:16:3e:dc:97:0f, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:06:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Creating image(s)
Nov 08 20:06:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "/opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "/opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "/opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.216s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.231s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk 1073741824" returned: 0 in 0.071s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Successfully created port: df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Cannot resize image /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Ensure instance console log exists: /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Successfully updated port: df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquired lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-b1f1c0d2-d083-40d4-9697-31cfd65aa181 req-1b9cc62f-05a6-4e78-b8d7-46ca9a90b76a service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received event network-changed-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-b1f1c0d2-d083-40d4-9697-31cfd65aa181 req-1b9cc62f-05a6-4e78-b8d7-46ca9a90b76a service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Refreshing instance network info cache due to event network-changed-df85f533-347b-49e1-bab5-5bd28eb584f0. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b1f1c0d2-d083-40d4-9697-31cfd65aa181 req-1b9cc62f-05a6-4e78-b8d7-46ca9a90b76a service nova] Acquiring lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-dabc9727-e540-4430-a973-7d8175d1ca23 req-e7eba2dc-5c8a-4283-9093-707187489d7e service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Received event network-vif-plugged-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dabc9727-e540-4430-a973-7d8175d1ca23 req-e7eba2dc-5c8a-4283-9093-707187489d7e service nova] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dabc9727-e540-4430-a973-7d8175d1ca23 req-e7eba2dc-5c8a-4283-9093-707187489d7e service nova] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dabc9727-e540-4430-a973-7d8175d1ca23 req-e7eba2dc-5c8a-4283-9093-707187489d7e service nova] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-dabc9727-e540-4430-a973-7d8175d1ca23 req-e7eba2dc-5c8a-4283-9093-707187489d7e service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] No waiting events found dispatching network-vif-plugged-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:44 user nova-compute[74638]: WARNING nova.compute.manager [req-dabc9727-e540-4430-a973-7d8175d1ca23 req-e7eba2dc-5c8a-4283-9093-707187489d7e service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Received unexpected event network-vif-plugged-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 for instance with vm_state building and task_state spawning.
Nov 08 20:06:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Updating instance_info_cache with network_info: [{"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Releasing lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Instance network_info: |[{"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b1f1c0d2-d083-40d4-9697-31cfd65aa181 req-1b9cc62f-05a6-4e78-b8d7-46ca9a90b76a service nova] Acquired lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-b1f1c0d2-d083-40d4-9697-31cfd65aa181 req-1b9cc62f-05a6-4e78-b8d7-46ca9a90b76a service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Refreshing network info cache for port df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Start _get_guest_xml network_info=[{"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:06:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1687685711',display_name='tempest-VolumesAssistedSnapshotsTest-server-1687685711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1687685711',id=9,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Mem4B6J0AiaVvWanP0bS8E8qVPlmxgP+rMqm1r8Zmodb9b58xvTBuq+63fBivZOJmpwRIfu7RzWtF7rZHhAwltv2wzg66LSFp797gy4Qwie3f/gIJJqGvDs3KKAM7xQ==',key_name='tempest-keypair-99988218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb598f0e209b4d56b65c1d505983dfa3',ramdisk_id='',reservation_id='r-cd04m0jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1643410518',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1643410518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6f6f6751f3748edb79062052cab2b3e',uuid=03d6123e-19ab-4fcf-9df5-770ca5e30422,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Converting VIF {"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e4:84,bridge_name='br-int',has_traffic_filtering=True,id=df85f533-347b-49e1-bab5-5bd28eb584f0,network=Network(56416715-5ac0-436f-9a82-3ce7220008e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf85f533-34') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lazy-loading 'pci_devices' on Instance uuid 03d6123e-19ab-4fcf-9df5-770ca5e30422 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:06:45 user nova-compute[74638]:   <uuid>03d6123e-19ab-4fcf-9df5-770ca5e30422</uuid>
Nov 08 20:06:45 user nova-compute[74638]:   <name>instance-00000009</name>
Nov 08 20:06:45 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:06:45 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:06:45 user nova-compute[74638]:   <metadata>
Nov 08 20:06:45 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:06:45 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:06:45 user nova-compute[74638]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1687685711</nova:name>
Nov 08 20:06:45 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:06:45</nova:creationTime>
Nov 08 20:06:45 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:06:45 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:06:45 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:06:45 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:06:45 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:06:45 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:06:45 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:06:45 user nova-compute[74638]:       <nova:owner>
Nov 08 20:06:45 user nova-compute[74638]:         <nova:user uuid="d6f6f6751f3748edb79062052cab2b3e">tempest-VolumesAssistedSnapshotsTest-1643410518-project-member</nova:user>
Nov 08 20:06:45 user nova-compute[74638]:         <nova:project uuid="bb598f0e209b4d56b65c1d505983dfa3">tempest-VolumesAssistedSnapshotsTest-1643410518</nova:project>
Nov 08 20:06:45 user nova-compute[74638]:       </nova:owner>
Nov 08 20:06:45 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:06:45 user nova-compute[74638]:       <nova:ports>
Nov 08 20:06:45 user nova-compute[74638]:         <nova:port uuid="df85f533-347b-49e1-bab5-5bd28eb584f0">
Nov 08 20:06:45 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:06:45 user nova-compute[74638]:         </nova:port>
Nov 08 20:06:45 user nova-compute[74638]:       </nova:ports>
Nov 08 20:06:45 user nova-compute[74638]:     </nova:instance>
Nov 08 20:06:45 user nova-compute[74638]:   </metadata>
Nov 08 20:06:45 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:06:45 user nova-compute[74638]:     <system>
Nov 08 20:06:45 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:06:45 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:06:45 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:06:45 user nova-compute[74638]:       <entry name="serial">03d6123e-19ab-4fcf-9df5-770ca5e30422</entry>
Nov 08 20:06:45 user nova-compute[74638]:       <entry name="uuid">03d6123e-19ab-4fcf-9df5-770ca5e30422</entry>
Nov 08 20:06:45 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:06:45 user nova-compute[74638]:     </system>
Nov 08 20:06:45 user nova-compute[74638]:   </sysinfo>
Nov 08 20:06:45 user nova-compute[74638]:   <os>
Nov 08 20:06:45 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:06:45 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:06:45 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:06:45 user nova-compute[74638]:   </os>
Nov 08 20:06:45 user nova-compute[74638]:   <features>
Nov 08 20:06:45 user nova-compute[74638]:     <acpi/>
Nov 08 20:06:45 user nova-compute[74638]:     <apic/>
Nov 08 20:06:45 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:06:45 user nova-compute[74638]:   </features>
Nov 08 20:06:45 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:06:45 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:06:45 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:06:45 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:06:45 user nova-compute[74638]:   </clock>
Nov 08 20:06:45 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:06:45 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:06:45 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:06:45 user nova-compute[74638]:   </cpu>
Nov 08 20:06:45 user nova-compute[74638]:   <devices>
Nov 08 20:06:45 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:06:45 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:06:45 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk"/>
Nov 08 20:06:45 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:06:45 user nova-compute[74638]:     </disk>
Nov 08 20:06:45 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:06:45 user nova-compute[74638]:       <mac address="fa:16:3e:2e:e4:84"/>
Nov 08 20:06:45 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:45 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:06:45 user nova-compute[74638]:       <target dev="tapdf85f533-34"/>
Nov 08 20:06:45 user nova-compute[74638]:     </interface>
Nov 08 20:06:45 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:06:45 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/console.log" append="off"/>
Nov 08 20:06:45 user nova-compute[74638]:     </serial>
Nov 08 20:06:45 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:06:45 user nova-compute[74638]:     <video>
Nov 08 20:06:45 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:06:45 user nova-compute[74638]:     </video>
Nov 08 20:06:45 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:06:45 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:06:45 user nova-compute[74638]:     </rng>
Nov 08 20:06:45 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:06:45 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:06:45 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:06:45 user nova-compute[74638]:     </memballoon>
Nov 08 20:06:45 user nova-compute[74638]:   </devices>
Nov 08 20:06:45 user nova-compute[74638]: </domain>
Nov 08 20:06:45 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1687685711',display_name='tempest-VolumesAssistedSnapshotsTest-server-1687685711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1687685711',id=9,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Mem4B6J0AiaVvWanP0bS8E8qVPlmxgP+rMqm1r8Zmodb9b58xvTBuq+63fBivZOJmpwRIfu7RzWtF7rZHhAwltv2wzg66LSFp797gy4Qwie3f/gIJJqGvDs3KKAM7xQ==',key_name='tempest-keypair-99988218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb598f0e209b4d56b65c1d505983dfa3',ramdisk_id='',reservation_id='r-cd04m0jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1643410518',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1643410518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6f6f6751f3748edb79062052cab2b3e',uuid=03d6123e-19ab-4fcf-9df5-770ca5e30422,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Converting VIF {"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e4:84,bridge_name='br-int',has_traffic_filtering=True,id=df85f533-347b-49e1-bab5-5bd28eb584f0,network=Network(56416715-5ac0-436f-9a82-3ce7220008e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf85f533-34') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG os_vif [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e4:84,bridge_name='br-int',has_traffic_filtering=True,id=df85f533-347b-49e1-bab5-5bd28eb584f0,network=Network(56416715-5ac0-436f-9a82-3ce7220008e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf85f533-34') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f083ccf-a7ca-5d7d-80f4-65eae616b88e', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf85f533-34, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf85f533-34, col_values=(('qos', UUID('614fe6cd-a832-4304-b656-1e95a210ece9')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf85f533-34, col_values=(('external_ids', {'iface-id': 'df85f533-347b-49e1-bab5-5bd28eb584f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:e4:84', 'vm-uuid': '03d6123e-19ab-4fcf-9df5-770ca5e30422'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: INFO os_vif [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e4:84,bridge_name='br-int',has_traffic_filtering=True,id=df85f533-347b-49e1-bab5-5bd28eb584f0,network=Network(56416715-5ac0-436f-9a82-3ce7220008e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf85f533-34')
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] No VIF found with MAC fa:16:3e:2e:e4:84, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-b1f1c0d2-d083-40d4-9697-31cfd65aa181 req-1b9cc62f-05a6-4e78-b8d7-46ca9a90b76a service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Updated VIF entry in instance network info cache for port df85f533-347b-49e1-bab5-5bd28eb584f0. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-b1f1c0d2-d083-40d4-9697-31cfd65aa181 req-1b9cc62f-05a6-4e78-b8d7-46ca9a90b76a service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Updating instance_info_cache with network_info: [{"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b1f1c0d2-d083-40d4-9697-31cfd65aa181 req-1b9cc62f-05a6-4e78-b8d7-46ca9a90b76a service nova] Releasing lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-4757e5da-0605-4d50-a8c2-c0aa08144c97 req-ad3cb88c-a7c2-470b-a5ee-571a5ea73cc6 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Received event network-vif-plugged-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4757e5da-0605-4d50-a8c2-c0aa08144c97 req-ad3cb88c-a7c2-470b-a5ee-571a5ea73cc6 service nova] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4757e5da-0605-4d50-a8c2-c0aa08144c97 req-ad3cb88c-a7c2-470b-a5ee-571a5ea73cc6 service nova] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4757e5da-0605-4d50-a8c2-c0aa08144c97 req-ad3cb88c-a7c2-470b-a5ee-571a5ea73cc6 service nova] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-4757e5da-0605-4d50-a8c2-c0aa08144c97 req-ad3cb88c-a7c2-470b-a5ee-571a5ea73cc6 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] No waiting events found dispatching network-vif-plugged-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:46 user nova-compute[74638]: WARNING nova.compute.manager [req-4757e5da-0605-4d50-a8c2-c0aa08144c97 req-ad3cb88c-a7c2-470b-a5ee-571a5ea73cc6 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Received unexpected event network-vif-plugged-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 for instance with vm_state building and task_state spawning.
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Instance spawned successfully.
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:47 user nova-compute[74638]: INFO nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Took 7.62 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:47 user nova-compute[74638]: INFO nova.compute.manager [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Took 8.69 seconds to build instance.
Nov 08 20:06:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ac5333a-3edf-4b72-b753-7ff6cf74d6a8 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.910s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received event network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] No waiting events found dispatching network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:48 user nova-compute[74638]: WARNING nova.compute.manager [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received unexpected event network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 for instance with vm_state building and task_state spawning.
Nov 08 20:06:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received event network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] No waiting events found dispatching network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:48 user nova-compute[74638]: WARNING nova.compute.manager [req-07284c46-d077-42d1-b914-09a79dea6688 req-15e8a9fc-e3e3-4fff-a543-b490e029a164 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received unexpected event network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 for instance with vm_state building and task_state spawning.
Nov 08 20:06:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:06:49 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Instance spawned successfully.
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:06:49 user nova-compute[74638]: INFO nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 08 20:06:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:06:49 user nova-compute[74638]: INFO nova.compute.manager [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Took 8.02 seconds to build instance.
Nov 08 20:06:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bce9258e-0995-4dba-b3bd-a37484a6c713 tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.175s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-bb55ca53-00e5-43b4-a7dd-3a8b2a942d33 req-0ede5804-4e8e-4f7f-bfa2-92ca226cb59c service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bb55ca53-00e5-43b4-a7dd-3a8b2a942d33 req-0ede5804-4e8e-4f7f-bfa2-92ca226cb59c service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bb55ca53-00e5-43b4-a7dd-3a8b2a942d33 req-0ede5804-4e8e-4f7f-bfa2-92ca226cb59c service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bb55ca53-00e5-43b4-a7dd-3a8b2a942d33 req-0ede5804-4e8e-4f7f-bfa2-92ca226cb59c service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-bb55ca53-00e5-43b4-a7dd-3a8b2a942d33 req-0ede5804-4e8e-4f7f-bfa2-92ca226cb59c service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:51 user nova-compute[74638]: WARNING nova.compute.manager [req-bb55ca53-00e5-43b4-a7dd-3a8b2a942d33 req-0ede5804-4e8e-4f7f-bfa2-92ca226cb59c service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state active and task_state None.
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.379s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:53 user nova-compute[74638]: WARNING nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state active and task_state None.
Nov 08 20:06:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] No waiting events found dispatching network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:53 user nova-compute[74638]: WARNING nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received unexpected event network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 for instance with vm_state active and task_state None.
Nov 08 20:06:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] No waiting events found dispatching network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:53 user nova-compute[74638]: WARNING nova.compute.manager [req-3fa28907-32df-4bfa-b906-28fc20f45643 req-63c1d5ca-4fc2-449b-8d76-ed5c2285c549 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received unexpected event network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 for instance with vm_state active and task_state None.
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:06:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:06:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:06:54 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=25.726455688476562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:06:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 59bd23e8-fb0e-4e75-b03f-a239e068b86d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 10037bd1-d710-4ce1-abe8-b1f5b657c828 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e8daf0a9-b049-4dad-8128-cb34cf241da3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance b2192b24-bca8-467c-b408-f6f645d5557f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 24b78656-ca13-42c8-b45c-e0c1526c1fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:06:55 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:06:56 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:06:56 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:06:56 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:06:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.586s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:06:57 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid 59bd23e8-fb0e-4e75-b03f-a239e068b86d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Updating instance_info_cache with network_info: [{"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-59bd23e8-fb0e-4e75-b03f-a239e068b86d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-2ace7a68-82e5-4cf0-a90f-818c21507706 req-8630ca32-ad48-4f13-9d07-dc10af336425 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received event network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2ace7a68-82e5-4cf0-a90f-818c21507706 req-8630ca32-ad48-4f13-9d07-dc10af336425 service nova] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2ace7a68-82e5-4cf0-a90f-818c21507706 req-8630ca32-ad48-4f13-9d07-dc10af336425 service nova] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2ace7a68-82e5-4cf0-a90f-818c21507706 req-8630ca32-ad48-4f13-9d07-dc10af336425 service nova] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:06:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-2ace7a68-82e5-4cf0-a90f-818c21507706 req-8630ca32-ad48-4f13-9d07-dc10af336425 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] No waiting events found dispatching network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:06:58 user nova-compute[74638]: WARNING nova.compute.manager [req-2ace7a68-82e5-4cf0-a90f-818c21507706 req-8630ca32-ad48-4f13-9d07-dc10af336425 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received unexpected event network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 for instance with vm_state active and task_state None.
Nov 08 20:07:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received event network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] No waiting events found dispatching network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:07:00 user nova-compute[74638]: WARNING nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received unexpected event network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 for instance with vm_state active and task_state None.
Nov 08 20:07:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] No waiting events found dispatching network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:07:00 user nova-compute[74638]: WARNING nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received unexpected event network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c for instance with vm_state active and task_state None.
Nov 08 20:07:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] No waiting events found dispatching network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:07:00 user nova-compute[74638]: WARNING nova.compute.manager [req-5a779592-f9f6-4cc4-98b6-00f82880b5ed req-03b80400-c7dc-4b26-a2a9-65bd107bb239 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received unexpected event network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c for instance with vm_state active and task_state None.
Nov 08 20:07:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:07:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:07:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:07:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:07:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:07:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:07:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:07:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:07:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:07:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:48 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:07:50 user nova-compute[74638]: INFO nova.compute.claims [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Claim successful on node user
Nov 08 20:07:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:07:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:07:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:07:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:07:51 user nova-compute[74638]: INFO nova.virt.block_device [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Booting with volume a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf at /dev/vda
Nov 08 20:07:51 user nova-compute[74638]: DEBUG os_brick.utils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:07:51 user nova-compute[74638]: INFO oslo.privsep.daemon [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpt6xs6wbl/privsep.sock']
Nov 08 20:07:51 user sudo[85973]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpt6xs6wbl/privsep.sock
Nov 08 20:07:51 user sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 20:07:51 user nova-compute[74638]: DEBUG nova.policy [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7f6cb5c4b445bab1b501bc8aff5523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f19fa23d934a7ea5ffb026c605c8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:07:51 user nova-compute[74638]: INFO nova.compute.claims [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Claim successful on node user
Nov 08 20:07:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:07:51 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:07:52 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.policy [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d337a855b2f47849995109533421233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc60419b64f4d509a058b6ad7c756f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lazy-loading 'flavor' on Instance uuid 59bd23e8-fb0e-4e75-b03f-a239e068b86d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:07:52 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Creating image(s)
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "/opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "/opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "/opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:52 user nova-compute[74638]: INFO nova.compute.manager [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Attaching volume eb2d7e5c-455e-47e4-9da4-20c1e34bd219 to /dev/vdb
Nov 08 20:07:52 user nova-compute[74638]: DEBUG os_brick.utils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk 1073741824" returned: 0 in 0.051s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:52 user sudo[85973]: pam_unix(sudo:session): session closed for user root
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:52 user nova-compute[74638]: INFO oslo.privsep.daemon [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Spawned new privsep daemon via rootwrap
Nov 08 20:07:52 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 20:07:52 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 20:07:52 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 20:07:52 user nova-compute[74638]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85977
Nov 08 20:07:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4285cac-0c6d-4c24-91ed-755c71752125]: (2,) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:52 user nova-compute[74638]: WARNING oslo_privsep.priv_context [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] privsep daemon already running
Nov 08 20:07:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Successfully created port: 705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.247s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c84d623-fcab-425f-8dcb-d0a2e4e5551d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18da22b-8e23-4967-9441-1faa4db3c649]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: WARNING os_brick.initiator.connectors.nvmeof [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea60aa04-6b71-49d6-8b21-da5eb67badba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a06f60-ca51-40e9-a6ee-240c13f5cdf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88e8485-7b2e-48cc-a04e-dd5fa2789b3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0634b845-50d9-496c-8afe-12204516808d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed56c27-23ab-4b86-a36a-225957e0810c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dba1912-c7d3-4a82-8ace-637bbea009f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Cannot resize image /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Ensure instance console log exists: /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:07:53 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e0759f-c7e1-48e3-a218-7f2347f51393]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.utils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] <== get_connector_properties: return (570ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Updating existing volume attachment record: 19d36062-a15e-4cdb-9ed1-7a90968dabb6 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:07:53 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[696356a2-4292-40c8-a191-78e96b49c8c8]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG os_brick.utils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== get_connector_properties: return (2045ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating existing volume attachment record: 49106e3d-080b-4c8f-8133-c47e3f772552 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully created port: 39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Updating instance_info_cache with network_info: [{"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-af2b3651-064f-4b0b-95d4-be4641a16e4b req-9c00df43-9a12-40d5-a35d-2a3f8e16b303 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received event network-changed-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-af2b3651-064f-4b0b-95d4-be4641a16e4b req-9c00df43-9a12-40d5-a35d-2a3f8e16b303 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Refreshing instance network info cache due to event network-changed-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-af2b3651-064f-4b0b-95d4-be4641a16e4b req-9c00df43-9a12-40d5-a35d-2a3f8e16b303 service nova] Acquiring lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-af2b3651-064f-4b0b-95d4-be4641a16e4b req-9c00df43-9a12-40d5-a35d-2a3f8e16b303 service nova] Acquired lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-af2b3651-064f-4b0b-95d4-be4641a16e4b req-9c00df43-9a12-40d5-a35d-2a3f8e16b303 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Refreshing network info cache for port 8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.network.neutron [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Successfully updated port: 705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "refresh_cache-c73c46a2-e8b7-45a3-89ef-5a90683154b8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquired lock "refresh_cache-c73c46a2-e8b7-45a3-89ef-5a90683154b8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.network.neutron [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-942f88a2-fabb-49e1-8d9e-7e3df1f0ac7c req-f22ed7da-37a1-48ae-9453-f1b6a8b48515 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-changed-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-942f88a2-fabb-49e1-8d9e-7e3df1f0ac7c req-f22ed7da-37a1-48ae-9453-f1b6a8b48515 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Refreshing instance network info cache due to event network-changed-705c6863-ac49-49b6-b17b-c01584e2232e. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:07:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-942f88a2-fabb-49e1-8d9e-7e3df1f0ac7c req-f22ed7da-37a1-48ae-9453-f1b6a8b48515 service nova] Acquiring lock "refresh_cache-c73c46a2-e8b7-45a3-89ef-5a90683154b8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG nova.network.neutron [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG nova.network.neutron [req-af2b3651-064f-4b0b-95d4-be4641a16e4b req-9c00df43-9a12-40d5-a35d-2a3f8e16b303 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updated VIF entry in instance network info cache for port 8e07c583-ff9b-4cd7-938e-d9464fa8b1b8. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG nova.network.neutron [req-af2b3651-064f-4b0b-95d4-be4641a16e4b req-9c00df43-9a12-40d5-a35d-2a3f8e16b303 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updating instance_info_cache with network_info: [{"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:07:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-af2b3651-064f-4b0b-95d4-be4641a16e4b req-9c00df43-9a12-40d5-a35d-2a3f8e16b303 service nova] Releasing lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Updating instance_info_cache with network_info: [{"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Releasing lock "refresh_cache-c73c46a2-e8b7-45a3-89ef-5a90683154b8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Instance network_info: |[{"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-942f88a2-fabb-49e1-8d9e-7e3df1f0ac7c req-f22ed7da-37a1-48ae-9453-f1b6a8b48515 service nova] Acquired lock "refresh_cache-c73c46a2-e8b7-45a3-89ef-5a90683154b8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.network.neutron [req-942f88a2-fabb-49e1-8d9e-7e3df1f0ac7c req-f22ed7da-37a1-48ae-9453-f1b6a8b48515 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Refreshing network info cache for port 705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Start _get_guest_xml network_info=[{"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:07:55 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:07:55 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2013768952',display_name='tempest-ServersNegativeTestJSON-server-2013768952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2013768952',id=11,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc60419b64f4d509a058b6ad7c756f6',ramdisk_id='',reservation_id='r-70v5kqwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-300367152',owner_user_name='tempest-ServersNegativeTestJSON-300367152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:52Z,user_data=None,user_id='4d337a855b2f47849995109533421233',uuid=c73c46a2-e8b7-45a3-89ef-5a90683154b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converting VIF {"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:79,bridge_name='br-int',has_traffic_filtering=True,id=705c6863-ac49-49b6-b17b-c01584e2232e,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705c6863-ac') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.objects.instance [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lazy-loading 'pci_devices' on Instance uuid c73c46a2-e8b7-45a3-89ef-5a90683154b8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully created port: 14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:07:55 user nova-compute[74638]:   <uuid>c73c46a2-e8b7-45a3-89ef-5a90683154b8</uuid>
Nov 08 20:07:55 user nova-compute[74638]:   <name>instance-0000000b</name>
Nov 08 20:07:55 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:07:55 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:07:55 user nova-compute[74638]:   <metadata>
Nov 08 20:07:55 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:07:55 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:07:55 user nova-compute[74638]:       <nova:name>tempest-ServersNegativeTestJSON-server-2013768952</nova:name>
Nov 08 20:07:55 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:07:55</nova:creationTime>
Nov 08 20:07:55 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:07:55 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:07:55 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:07:55 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:07:55 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:07:55 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:07:55 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:07:55 user nova-compute[74638]:       <nova:owner>
Nov 08 20:07:55 user nova-compute[74638]:         <nova:user uuid="4d337a855b2f47849995109533421233">tempest-ServersNegativeTestJSON-300367152-project-member</nova:user>
Nov 08 20:07:55 user nova-compute[74638]:         <nova:project uuid="fcc60419b64f4d509a058b6ad7c756f6">tempest-ServersNegativeTestJSON-300367152</nova:project>
Nov 08 20:07:55 user nova-compute[74638]:       </nova:owner>
Nov 08 20:07:55 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:07:55 user nova-compute[74638]:       <nova:ports>
Nov 08 20:07:55 user nova-compute[74638]:         <nova:port uuid="705c6863-ac49-49b6-b17b-c01584e2232e">
Nov 08 20:07:55 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 20:07:55 user nova-compute[74638]:         </nova:port>
Nov 08 20:07:55 user nova-compute[74638]:       </nova:ports>
Nov 08 20:07:55 user nova-compute[74638]:     </nova:instance>
Nov 08 20:07:55 user nova-compute[74638]:   </metadata>
Nov 08 20:07:55 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:07:55 user nova-compute[74638]:     <system>
Nov 08 20:07:55 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:07:55 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:07:55 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:07:55 user nova-compute[74638]:       <entry name="serial">c73c46a2-e8b7-45a3-89ef-5a90683154b8</entry>
Nov 08 20:07:55 user nova-compute[74638]:       <entry name="uuid">c73c46a2-e8b7-45a3-89ef-5a90683154b8</entry>
Nov 08 20:07:55 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:07:55 user nova-compute[74638]:     </system>
Nov 08 20:07:55 user nova-compute[74638]:   </sysinfo>
Nov 08 20:07:55 user nova-compute[74638]:   <os>
Nov 08 20:07:55 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:07:55 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:07:55 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:07:55 user nova-compute[74638]:   </os>
Nov 08 20:07:55 user nova-compute[74638]:   <features>
Nov 08 20:07:55 user nova-compute[74638]:     <acpi/>
Nov 08 20:07:55 user nova-compute[74638]:     <apic/>
Nov 08 20:07:55 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:07:55 user nova-compute[74638]:   </features>
Nov 08 20:07:55 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:07:55 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:07:55 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:07:55 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:07:55 user nova-compute[74638]:   </clock>
Nov 08 20:07:55 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:07:55 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:07:55 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:07:55 user nova-compute[74638]:   </cpu>
Nov 08 20:07:55 user nova-compute[74638]:   <devices>
Nov 08 20:07:55 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:07:55 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:07:55 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk"/>
Nov 08 20:07:55 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:07:55 user nova-compute[74638]:     </disk>
Nov 08 20:07:55 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:07:55 user nova-compute[74638]:       <mac address="fa:16:3e:e5:8d:79"/>
Nov 08 20:07:55 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:07:55 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:07:55 user nova-compute[74638]:       <target dev="tap705c6863-ac"/>
Nov 08 20:07:55 user nova-compute[74638]:     </interface>
Nov 08 20:07:55 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:07:55 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/console.log" append="off"/>
Nov 08 20:07:55 user nova-compute[74638]:     </serial>
Nov 08 20:07:55 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:07:55 user nova-compute[74638]:     <video>
Nov 08 20:07:55 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:07:55 user nova-compute[74638]:     </video>
Nov 08 20:07:55 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:07:55 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:07:55 user nova-compute[74638]:     </rng>
Nov 08 20:07:55 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:07:55 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:07:55 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:07:55 user nova-compute[74638]:     </memballoon>
Nov 08 20:07:55 user nova-compute[74638]:   </devices>
Nov 08 20:07:55 user nova-compute[74638]: </domain>
Nov 08 20:07:55 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2013768952',display_name='tempest-ServersNegativeTestJSON-server-2013768952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2013768952',id=11,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc60419b64f4d509a058b6ad7c756f6',ramdisk_id='',reservation_id='r-70v5kqwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-300367152',owner_user_name='tempest-ServersNegativeTestJSON-300367152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:52Z,user_data=None,user_id='4d337a855b2f47849995109533421233',uuid=c73c46a2-e8b7-45a3-89ef-5a90683154b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converting VIF {"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:79,bridge_name='br-int',has_traffic_filtering=True,id=705c6863-ac49-49b6-b17b-c01584e2232e,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705c6863-ac') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG os_vif [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:79,bridge_name='br-int',has_traffic_filtering=True,id=705c6863-ac49-49b6-b17b-c01584e2232e,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705c6863-ac') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1bdd2f0-01fe-5b7f-a7bd-488a886eab6d', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-a7f9e7a1-1865-40fe-a651-351738970f07 req-ce30a502-ae64-42c6-aaec-cfcea14f0b2d service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-changed-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-a7f9e7a1-1865-40fe-a651-351738970f07 req-ce30a502-ae64-42c6-aaec-cfcea14f0b2d service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Refreshing instance network info cache due to event network-changed-2dae479f-02ee-40bc-8a5d-436e3931e032. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a7f9e7a1-1865-40fe-a651-351738970f07 req-ce30a502-ae64-42c6-aaec-cfcea14f0b2d service nova] Acquiring lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a7f9e7a1-1865-40fe-a651-351738970f07 req-ce30a502-ae64-42c6-aaec-cfcea14f0b2d service nova] Acquired lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG nova.network.neutron [req-a7f9e7a1-1865-40fe-a651-351738970f07 req-ce30a502-ae64-42c6-aaec-cfcea14f0b2d service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Refreshing network info cache for port 2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap705c6863-ac, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap705c6863-ac, col_values=(('qos', UUID('22b1e339-ff12-493f-bcd3-a0d4f8fb2c90')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap705c6863-ac, col_values=(('external_ids', {'iface-id': '705c6863-ac49-49b6-b17b-c01584e2232e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:8d:79', 'vm-uuid': 'c73c46a2-e8b7-45a3-89ef-5a90683154b8'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:07:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:56 user nova-compute[74638]: INFO os_vif [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:79,bridge_name='br-int',has_traffic_filtering=True,id=705c6863-ac49-49b6-b17b-c01584e2232e,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705c6863-ac')
Nov 08 20:07:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] No VIF found with MAC fa:16:3e:e5:8d:79, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-942f88a2-fabb-49e1-8d9e-7e3df1f0ac7c req-f22ed7da-37a1-48ae-9453-f1b6a8b48515 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Updated VIF entry in instance network info cache for port 705c6863-ac49-49b6-b17b-c01584e2232e. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:07:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-942f88a2-fabb-49e1-8d9e-7e3df1f0ac7c req-f22ed7da-37a1-48ae-9453-f1b6a8b48515 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Updating instance_info_cache with network_info: [{"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-942f88a2-fabb-49e1-8d9e-7e3df1f0ac7c req-f22ed7da-37a1-48ae-9453-f1b6a8b48515 service nova] Releasing lock "refresh_cache-c73c46a2-e8b7-45a3-89ef-5a90683154b8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully created port: 31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG nova.network.neutron [req-a7f9e7a1-1865-40fe-a651-351738970f07 req-ce30a502-ae64-42c6-aaec-cfcea14f0b2d service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updated VIF entry in instance network info cache for port 2dae479f-02ee-40bc-8a5d-436e3931e032. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG nova.network.neutron [req-a7f9e7a1-1865-40fe-a651-351738970f07 req-ce30a502-ae64-42c6-aaec-cfcea14f0b2d service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating instance_info_cache with network_info: [{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a7f9e7a1-1865-40fe-a651-351738970f07 req-ce30a502-ae64-42c6-aaec-cfcea14f0b2d service nova] Releasing lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-03a33f4e-b10c-4ef0-9188-ccecab3b0025 req-125edec7-a411-46cf-b012-e83f42d9cc4c service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-changed-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-03a33f4e-b10c-4ef0-9188-ccecab3b0025 req-125edec7-a411-46cf-b012-e83f42d9cc4c service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Refreshing instance network info cache due to event network-changed-fe0448bd-7de8-4903-85a8-e9e452f2fec2. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-03a33f4e-b10c-4ef0-9188-ccecab3b0025 req-125edec7-a411-46cf-b012-e83f42d9cc4c service nova] Acquiring lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-03a33f4e-b10c-4ef0-9188-ccecab3b0025 req-125edec7-a411-46cf-b012-e83f42d9cc4c service nova] Acquired lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG nova.network.neutron [req-03a33f4e-b10c-4ef0-9188-ccecab3b0025 req-125edec7-a411-46cf-b012-e83f42d9cc4c service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Refreshing network info cache for port fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfa7ae7d-aee2-4ec7-832c-8245c9550477 req-ec9345bd-3191-41cc-a49f-621dbb50ae93 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfa7ae7d-aee2-4ec7-832c-8245c9550477 req-ec9345bd-3191-41cc-a49f-621dbb50ae93 service nova] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfa7ae7d-aee2-4ec7-832c-8245c9550477 req-ec9345bd-3191-41cc-a49f-621dbb50ae93 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfa7ae7d-aee2-4ec7-832c-8245c9550477 req-ec9345bd-3191-41cc-a49f-621dbb50ae93 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfa7ae7d-aee2-4ec7-832c-8245c9550477 req-ec9345bd-3191-41cc-a49f-621dbb50ae93 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] No waiting events found dispatching network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:07:58 user nova-compute[74638]: WARNING nova.compute.manager [req-dfa7ae7d-aee2-4ec7-832c-8245c9550477 req-ec9345bd-3191-41cc-a49f-621dbb50ae93 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received unexpected event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e for instance with vm_state building and task_state spawning.
Nov 08 20:07:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully created port: 6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:07:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully created port: dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-cafbcef4-7733-4f03-b389-577ebc583996 req-d5cde414-8f18-45dd-bc47-09830b947fe6 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cafbcef4-7733-4f03-b389-577ebc583996 req-d5cde414-8f18-45dd-bc47-09830b947fe6 service nova] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cafbcef4-7733-4f03-b389-577ebc583996 req-d5cde414-8f18-45dd-bc47-09830b947fe6 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cafbcef4-7733-4f03-b389-577ebc583996 req-d5cde414-8f18-45dd-bc47-09830b947fe6 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-cafbcef4-7733-4f03-b389-577ebc583996 req-d5cde414-8f18-45dd-bc47-09830b947fe6 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] No waiting events found dispatching network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:08:00 user nova-compute[74638]: WARNING nova.compute.manager [req-cafbcef4-7733-4f03-b389-577ebc583996 req-d5cde414-8f18-45dd-bc47-09830b947fe6 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received unexpected event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e for instance with vm_state building and task_state spawning.
Nov 08 20:08:00 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:08:00 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7305MB free_disk=25.62177276611328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:00 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Instance spawned successfully.
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:01 user nova-compute[74638]: INFO nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Took 8.78 seconds to spawn the instance on the hypervisor.
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 59bd23e8-fb0e-4e75-b03f-a239e068b86d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 10037bd1-d710-4ce1-abe8-b1f5b657c828 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e8daf0a9-b049-4dad-8128-cb34cf241da3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance b2192b24-bca8-467c-b408-f6f645d5557f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 24b78656-ca13-42c8-b45c-e0c1526c1fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a690cfa9-2a34-43a9-843b-e7548703a5e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c73c46a2-e8b7-45a3-89ef-5a90683154b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.network.neutron [req-03a33f4e-b10c-4ef0-9188-ccecab3b0025 req-125edec7-a411-46cf-b012-e83f42d9cc4c service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updated VIF entry in instance network info cache for port fe0448bd-7de8-4903-85a8-e9e452f2fec2. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.network.neutron [req-03a33f4e-b10c-4ef0-9188-ccecab3b0025 req-125edec7-a411-46cf-b012-e83f42d9cc4c service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-03a33f4e-b10c-4ef0-9188-ccecab3b0025 req-125edec7-a411-46cf-b012-e83f42d9cc4c service nova] Releasing lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:01 user nova-compute[74638]: INFO nova.compute.manager [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Took 9.69 seconds to build instance.
Nov 08 20:08:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-36cf1e71-76a1-47e5-b100-0b936b02bd7f tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.826s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.753s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully updated port: 39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.manager [req-66897dd0-da3c-447c-ae79-d57e8233208e req-6114e33d-d972-468e-887b-0e2fe31d7712 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-changed-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.compute.manager [req-66897dd0-da3c-447c-ae79-d57e8233208e req-6114e33d-d972-468e-887b-0e2fe31d7712 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing instance network info cache due to event network-changed-39f6ae3f-3753-4366-9981-c55d3e1c5742. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-66897dd0-da3c-447c-ae79-d57e8233208e req-6114e33d-d972-468e-887b-0e2fe31d7712 service nova] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-66897dd0-da3c-447c-ae79-d57e8233208e req-6114e33d-d972-468e-887b-0e2fe31d7712 service nova] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.network.neutron [req-66897dd0-da3c-447c-ae79-d57e8233208e req-6114e33d-d972-468e-887b-0e2fe31d7712 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing network info cache for port 39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:01 user nova-compute[74638]: DEBUG nova.network.neutron [req-66897dd0-da3c-447c-ae79-d57e8233208e req-6114e33d-d972-468e-887b-0e2fe31d7712 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:08:02 user nova-compute[74638]: DEBUG nova.network.neutron [req-66897dd0-da3c-447c-ae79-d57e8233208e req-6114e33d-d972-468e-887b-0e2fe31d7712 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-66897dd0-da3c-447c-ae79-d57e8233208e req-6114e33d-d972-468e-887b-0e2fe31d7712 service nova] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:02 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully updated port: e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:03 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully updated port: d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-changed-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing instance network info cache due to event network-changed-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:03 user nova-compute[74638]: DEBUG nova.network.neutron [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing network info cache for port e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.network.neutron [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully updated port: 14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.network.neutron [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:04 user nova-compute[74638]: INFO nova.compute.manager [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Attaching volume 22b1bf19-c5b4-4f16-8acc-a26cc4177a92 to /dev/vdb
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-changed-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing instance network info cache due to event network-changed-d2fdd908-4718-40b1-9b99-5ebf4604b9df. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.network.neutron [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing network info cache for port d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG os_brick.utils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba37aa89-d110-4ba0-8e12-4c5a38889b22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac67eda6-e139-45ce-b432-3a1e9becff53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.network.neutron [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22f9378-0cf4-4c08-a5c4-2d6d271e503d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ea1226-1b04-41b8-adfa-54d416198f17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:04 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:08:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb0defe-d9b0-4429-b9f2-3cd34dd232ad]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG os_brick.utils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:04 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating existing volume attachment record: 457d5262-9e9d-441e-ac36-0a2846c6102a {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:08:05 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully updated port: 31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:05 user nova-compute[74638]: DEBUG nova.network.neutron [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-687c3dc7-08df-47a1-888d-a08338bd14c5 req-110ed044-b852-4e61-beb3-2adcf3fb1ab9 service nova] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-changed-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing instance network info cache due to event network-changed-14326ab0-0b69-421f-a8f2-415d96da78ae. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:05 user nova-compute[74638]: DEBUG nova.network.neutron [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing network info cache for port 14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-changed-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing instance network info cache due to event network-changed-31ed79ac-1c5f-4569-977b-afa85fec9d49. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing network info cache for port 31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully updated port: 6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0167cb75-31f5-477f-bbce-8394acbb31b8 req-785cf984-53f7-4fa2-b96f-8a5fc8a0b61c service nova] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Successfully updated port: dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-changed-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing instance network info cache due to event network-changed-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [{"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance network_info: |[{"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing network info cache for port 6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:08:09 user nova-compute[74638]: INFO nova.compute.claims [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Claim successful on node user
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updated VIF entry in instance network info cache for port 6a6b4dcd-90cb-4c1c-b2e4-f128d950e805. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [{"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-changed-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing instance network info cache due to event network-changed-dda4bb7c-991c-4ed3-893f-1db9ef50c161. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing network info cache for port dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:08:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.network.neutron [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updated VIF entry in instance network info cache for port dda4bb7c-991c-4ed3-893f-1db9ef50c161. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.network.neutron [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [{"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7eb6d050-2caf-4140-9212-f30fbaadf4c4 req-7a41c65e-5dfa-46aa-8415-1717864f82eb service nova] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.policy [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22b2dc262b9843fe99418689a6511efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06319d69a1c543989c144da2071557ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:08:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Creating image(s)
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "/opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "/opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "/opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk 1073741824" returned: 0 in 0.054s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Successfully created port: 57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:08:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Cannot resize image /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Ensure instance console log exists: /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Successfully updated port: 57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquired lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-adf0f2d2-56ee-4d27-81f2-6a524d3e5623 req-b57c6b81-ebeb-48e9-8932-fc3a741f754b service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received event network-changed-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-adf0f2d2-56ee-4d27-81f2-6a524d3e5623 req-b57c6b81-ebeb-48e9-8932-fc3a741f754b service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Refreshing instance network info cache due to event network-changed-57b2113f-dc55-4a33-9bd0-965a4eae35dd. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-adf0f2d2-56ee-4d27-81f2-6a524d3e5623 req-b57c6b81-ebeb-48e9-8932-fc3a741f754b service nova] Acquiring lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Updating instance_info_cache with network_info: [{"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Releasing lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Instance network_info: |[{"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-adf0f2d2-56ee-4d27-81f2-6a524d3e5623 req-b57c6b81-ebeb-48e9-8932-fc3a741f754b service nova] Acquired lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-adf0f2d2-56ee-4d27-81f2-6a524d3e5623 req-b57c6b81-ebeb-48e9-8932-fc3a741f754b service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Refreshing network info cache for port 57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Start _get_guest_xml network_info=[{"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:08:11 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:08:11 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1882246038',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1882246038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1882246',id=12,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0Vgi9ZgDsItlNC7CEk8h8/kSOGciWmeh0bLWM8ezpa+JfKiEA7F8Ki0d4GJGrUt5Q04ro69vOKtsZYCoKtP2oR9Nf61zTfdstNTH24PTSAwNK4pO67+RS9Ufw1QYxE6g==',key_name='tempest-keypair-1191401701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06319d69a1c543989c144da2071557ab',ramdisk_id='',reservation_id='r-yi6rq6e7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-214754820',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22b2dc262b9843fe99418689a6511efc',uuid=204d636f-c342-45df-a083-7aa388a62c54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Converting VIF {"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:24:cf,bridge_name='br-int',has_traffic_filtering=True,id=57b2113f-dc55-4a33-9bd0-965a4eae35dd,network=Network(11cc2465-90cf-4451-9c70-34a752a110f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b2113f-dc') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lazy-loading 'pci_devices' on Instance uuid 204d636f-c342-45df-a083-7aa388a62c54 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:08:11 user nova-compute[74638]:   <uuid>204d636f-c342-45df-a083-7aa388a62c54</uuid>
Nov 08 20:08:11 user nova-compute[74638]:   <name>instance-0000000c</name>
Nov 08 20:08:11 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:08:11 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:08:11 user nova-compute[74638]:   <metadata>
Nov 08 20:08:11 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:08:11 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:08:11 user nova-compute[74638]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1882246038</nova:name>
Nov 08 20:08:11 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:08:11</nova:creationTime>
Nov 08 20:08:11 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:08:11 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:08:11 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:08:11 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:08:11 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:08:11 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:08:11 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:08:11 user nova-compute[74638]:       <nova:owner>
Nov 08 20:08:11 user nova-compute[74638]:         <nova:user uuid="22b2dc262b9843fe99418689a6511efc">tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member</nova:user>
Nov 08 20:08:11 user nova-compute[74638]:         <nova:project uuid="06319d69a1c543989c144da2071557ab">tempest-TestServerVolumeAttachScenarioOldVersion-214754820</nova:project>
Nov 08 20:08:11 user nova-compute[74638]:       </nova:owner>
Nov 08 20:08:11 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:08:11 user nova-compute[74638]:       <nova:ports>
Nov 08 20:08:11 user nova-compute[74638]:         <nova:port uuid="57b2113f-dc55-4a33-9bd0-965a4eae35dd">
Nov 08 20:08:11 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 20:08:11 user nova-compute[74638]:         </nova:port>
Nov 08 20:08:11 user nova-compute[74638]:       </nova:ports>
Nov 08 20:08:11 user nova-compute[74638]:     </nova:instance>
Nov 08 20:08:11 user nova-compute[74638]:   </metadata>
Nov 08 20:08:11 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:08:11 user nova-compute[74638]:     <system>
Nov 08 20:08:11 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:08:11 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:08:11 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:08:11 user nova-compute[74638]:       <entry name="serial">204d636f-c342-45df-a083-7aa388a62c54</entry>
Nov 08 20:08:11 user nova-compute[74638]:       <entry name="uuid">204d636f-c342-45df-a083-7aa388a62c54</entry>
Nov 08 20:08:11 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:08:11 user nova-compute[74638]:     </system>
Nov 08 20:08:11 user nova-compute[74638]:   </sysinfo>
Nov 08 20:08:11 user nova-compute[74638]:   <os>
Nov 08 20:08:11 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:08:11 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:08:11 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:08:11 user nova-compute[74638]:   </os>
Nov 08 20:08:11 user nova-compute[74638]:   <features>
Nov 08 20:08:11 user nova-compute[74638]:     <acpi/>
Nov 08 20:08:11 user nova-compute[74638]:     <apic/>
Nov 08 20:08:11 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:08:11 user nova-compute[74638]:   </features>
Nov 08 20:08:11 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:08:11 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:08:11 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:08:11 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:08:11 user nova-compute[74638]:   </clock>
Nov 08 20:08:11 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:08:11 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:08:11 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:08:11 user nova-compute[74638]:   </cpu>
Nov 08 20:08:11 user nova-compute[74638]:   <devices>
Nov 08 20:08:11 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:08:11 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:08:11 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk"/>
Nov 08 20:08:11 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:08:11 user nova-compute[74638]:     </disk>
Nov 08 20:08:11 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:08:11 user nova-compute[74638]:       <mac address="fa:16:3e:6f:24:cf"/>
Nov 08 20:08:11 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:08:11 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:08:11 user nova-compute[74638]:       <target dev="tap57b2113f-dc"/>
Nov 08 20:08:11 user nova-compute[74638]:     </interface>
Nov 08 20:08:11 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:08:11 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/console.log" append="off"/>
Nov 08 20:08:11 user nova-compute[74638]:     </serial>
Nov 08 20:08:11 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:08:11 user nova-compute[74638]:     <video>
Nov 08 20:08:11 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:08:11 user nova-compute[74638]:     </video>
Nov 08 20:08:11 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:08:11 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:08:11 user nova-compute[74638]:     </rng>
Nov 08 20:08:11 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:08:11 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:08:11 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:08:11 user nova-compute[74638]:     </memballoon>
Nov 08 20:08:11 user nova-compute[74638]:   </devices>
Nov 08 20:08:11 user nova-compute[74638]: </domain>
Nov 08 20:08:11 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1882246038',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1882246038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1882246',id=12,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0Vgi9ZgDsItlNC7CEk8h8/kSOGciWmeh0bLWM8ezpa+JfKiEA7F8Ki0d4GJGrUt5Q04ro69vOKtsZYCoKtP2oR9Nf61zTfdstNTH24PTSAwNK4pO67+RS9Ufw1QYxE6g==',key_name='tempest-keypair-1191401701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06319d69a1c543989c144da2071557ab',ramdisk_id='',reservation_id='r-yi6rq6e7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-214754820',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22b2dc262b9843fe99418689a6511efc',uuid=204d636f-c342-45df-a083-7aa388a62c54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Converting VIF {"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:24:cf,bridge_name='br-int',has_traffic_filtering=True,id=57b2113f-dc55-4a33-9bd0-965a4eae35dd,network=Network(11cc2465-90cf-4451-9c70-34a752a110f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b2113f-dc') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG os_vif [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:24:cf,bridge_name='br-int',has_traffic_filtering=True,id=57b2113f-dc55-4a33-9bd0-965a4eae35dd,network=Network(11cc2465-90cf-4451-9c70-34a752a110f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b2113f-dc') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31ca70cc-cf31-5189-984a-0da2304187fd', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57b2113f-dc, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57b2113f-dc, col_values=(('qos', UUID('7b3e2213-5ca5-44e9-ba6f-fd67aea233e0')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57b2113f-dc, col_values=(('external_ids', {'iface-id': '57b2113f-dc55-4a33-9bd0-965a4eae35dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:24:cf', 'vm-uuid': '204d636f-c342-45df-a083-7aa388a62c54'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:12 user nova-compute[74638]: INFO os_vif [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:24:cf,bridge_name='br-int',has_traffic_filtering=True,id=57b2113f-dc55-4a33-9bd0-965a4eae35dd,network=Network(11cc2465-90cf-4451-9c70-34a752a110f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b2113f-dc')
Nov 08 20:08:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] No VIF found with MAC fa:16:3e:6f:24:cf, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG nova.network.neutron [req-adf0f2d2-56ee-4d27-81f2-6a524d3e5623 req-b57c6b81-ebeb-48e9-8932-fc3a741f754b service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Updated VIF entry in instance network info cache for port 57b2113f-dc55-4a33-9bd0-965a4eae35dd. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG nova.network.neutron [req-adf0f2d2-56ee-4d27-81f2-6a524d3e5623 req-b57c6b81-ebeb-48e9-8932-fc3a741f754b service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Updating instance_info_cache with network_info: [{"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-adf0f2d2-56ee-4d27-81f2-6a524d3e5623 req-b57c6b81-ebeb-48e9-8932-fc3a741f754b service nova] Releasing lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-a477c4a9-2cb3-443a-896c-0076514e67ed req-f6330912-d589-474f-a0f9-be7b47473e15 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received event network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a477c4a9-2cb3-443a-896c-0076514e67ed req-f6330912-d589-474f-a0f9-be7b47473e15 service nova] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a477c4a9-2cb3-443a-896c-0076514e67ed req-f6330912-d589-474f-a0f9-be7b47473e15 service nova] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a477c4a9-2cb3-443a-896c-0076514e67ed req-f6330912-d589-474f-a0f9-be7b47473e15 service nova] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-a477c4a9-2cb3-443a-896c-0076514e67ed req-f6330912-d589-474f-a0f9-be7b47473e15 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] No waiting events found dispatching network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:08:13 user nova-compute[74638]: WARNING nova.compute.manager [req-a477c4a9-2cb3-443a-896c-0076514e67ed req-f6330912-d589-474f-a0f9-be7b47473e15 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received unexpected event network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd for instance with vm_state building and task_state spawning.
Nov 08 20:08:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:08:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Instance spawned successfully.
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:08:15 user nova-compute[74638]: INFO nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-069ce30f-df7c-4f7d-961b-d84aa8b1690e req-6e09c799-67e6-462f-a64f-07ccc76fc4ca service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received event network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-069ce30f-df7c-4f7d-961b-d84aa8b1690e req-6e09c799-67e6-462f-a64f-07ccc76fc4ca service nova] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-069ce30f-df7c-4f7d-961b-d84aa8b1690e req-6e09c799-67e6-462f-a64f-07ccc76fc4ca service nova] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-069ce30f-df7c-4f7d-961b-d84aa8b1690e req-6e09c799-67e6-462f-a64f-07ccc76fc4ca service nova] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-069ce30f-df7c-4f7d-961b-d84aa8b1690e req-6e09c799-67e6-462f-a64f-07ccc76fc4ca service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] No waiting events found dispatching network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:08:15 user nova-compute[74638]: WARNING nova.compute.manager [req-069ce30f-df7c-4f7d-961b-d84aa8b1690e req-6e09c799-67e6-462f-a64f-07ccc76fc4ca service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received unexpected event network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd for instance with vm_state building and task_state spawning.
Nov 08 20:08:15 user nova-compute[74638]: INFO nova.compute.manager [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Took 6.39 seconds to build instance.
Nov 08 20:08:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0cdc67d1-59ce-4f20-bdc2-f7abe9ec02db tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.510s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-8ee72112-8fa3-4169-8ab1-7e63fed275a2 req-47a5e1d1-006d-4dc0-b896-84b25128b1e3 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received event network-changed-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-8ee72112-8fa3-4169-8ab1-7e63fed275a2 req-47a5e1d1-006d-4dc0-b896-84b25128b1e3 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Refreshing instance network info cache due to event network-changed-786b38d9-2eb5-4dff-9c4a-0776f304a821. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ee72112-8fa3-4169-8ab1-7e63fed275a2 req-47a5e1d1-006d-4dc0-b896-84b25128b1e3 service nova] Acquiring lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ee72112-8fa3-4169-8ab1-7e63fed275a2 req-47a5e1d1-006d-4dc0-b896-84b25128b1e3 service nova] Acquired lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:20 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ee72112-8fa3-4169-8ab1-7e63fed275a2 req-47a5e1d1-006d-4dc0-b896-84b25128b1e3 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Refreshing network info cache for port 786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:20 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ee72112-8fa3-4169-8ab1-7e63fed275a2 req-47a5e1d1-006d-4dc0-b896-84b25128b1e3 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Updated VIF entry in instance network info cache for port 786b38d9-2eb5-4dff-9c4a-0776f304a821. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:20 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ee72112-8fa3-4169-8ab1-7e63fed275a2 req-47a5e1d1-006d-4dc0-b896-84b25128b1e3 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Updating instance_info_cache with network_info: [{"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ee72112-8fa3-4169-8ab1-7e63fed275a2 req-47a5e1d1-006d-4dc0-b896-84b25128b1e3 service nova] Releasing lock "refresh_cache-e8daf0a9-b049-4dad-8128-cb34cf241da3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "interface-b2192b24-bca8-467c-b408-f6f645d5557f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "interface-b2192b24-bca8-467c-b408-f6f645d5557f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:21 user nova-compute[74638]: DEBUG nova.objects.instance [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lazy-loading 'flavor' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:21 user nova-compute[74638]: DEBUG nova.objects.instance [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lazy-loading 'pci_requests' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:21 user nova-compute[74638]: DEBUG nova.objects.base [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Object Instance<b2192b24-bca8-467c-b408-f6f645d5557f> lazy-loaded attributes: flavor,pci_requests {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:08:21 user nova-compute[74638]: DEBUG nova.network.neutron [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:08:21 user nova-compute[74638]: DEBUG nova.policy [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be705289f5974554ab1d6bc4e66735b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f180c62c64dcb83c30c7e3e8a5c4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Successfully created port: de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-d594fd09-722b-46d6-815d-f25fcc9051a2 req-01a9af06-0e05-408c-8bff-2a3bdb15b96d service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-changed-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-d594fd09-722b-46d6-815d-f25fcc9051a2 req-01a9af06-0e05-408c-8bff-2a3bdb15b96d service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Refreshing instance network info cache due to event network-changed-18e2eb15-f699-42ac-ac84-e6d446f1f59c. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d594fd09-722b-46d6-815d-f25fcc9051a2 req-01a9af06-0e05-408c-8bff-2a3bdb15b96d service nova] Acquiring lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d594fd09-722b-46d6-815d-f25fcc9051a2 req-01a9af06-0e05-408c-8bff-2a3bdb15b96d service nova] Acquired lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.network.neutron [req-d594fd09-722b-46d6-815d-f25fcc9051a2 req-01a9af06-0e05-408c-8bff-2a3bdb15b96d service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Refreshing network info cache for port 18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Successfully updated port: de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-b3b78a9b-b4ea-4938-bb16-166c1be5a1dd req-ce9f5dbe-85d7-4c6d-ad2e-911cb53d831b service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-changed-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-b3b78a9b-b4ea-4938-bb16-166c1be5a1dd req-ce9f5dbe-85d7-4c6d-ad2e-911cb53d831b service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Refreshing instance network info cache due to event network-changed-de0772c3-b1d6-4307-b55c-494418b9437c. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b3b78a9b-b4ea-4938-bb16-166c1be5a1dd req-ce9f5dbe-85d7-4c6d-ad2e-911cb53d831b service nova] Acquiring lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.network.neutron [req-d594fd09-722b-46d6-815d-f25fcc9051a2 req-01a9af06-0e05-408c-8bff-2a3bdb15b96d service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updated VIF entry in instance network info cache for port 18e2eb15-f699-42ac-ac84-e6d446f1f59c. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.network.neutron [req-d594fd09-722b-46d6-815d-f25fcc9051a2 req-01a9af06-0e05-408c-8bff-2a3bdb15b96d service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating instance_info_cache with network_info: [{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d594fd09-722b-46d6-815d-f25fcc9051a2 req-01a9af06-0e05-408c-8bff-2a3bdb15b96d service nova] Releasing lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquired lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating instance_info_cache with network_info: [{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Releasing lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b3b78a9b-b4ea-4938-bb16-166c1be5a1dd req-ce9f5dbe-85d7-4c6d-ad2e-911cb53d831b service nova] Acquired lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.network.neutron [req-b3b78a9b-b4ea-4938-bb16-166c1be5a1dd req-ce9f5dbe-85d7-4c6d-ad2e-911cb53d831b service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Refreshing network info cache for port de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converting VIF {"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG os_vif [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a598a914-c31b-52cb-a5dc-f99526df3b43', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde0772c3-b1, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde0772c3-b1, col_values=(('qos', UUID('0f7c441a-d149-479f-9adf-45b895d6e842')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde0772c3-b1, col_values=(('external_ids', {'iface-id': 'de0772c3-b1d6-4307-b55c-494418b9437c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:05:1d', 'vm-uuid': 'b2192b24-bca8-467c-b408-f6f645d5557f'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: INFO os_vif [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1')
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converting VIF {"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] attach device xml: <interface type="ethernet">
Nov 08 20:08:23 user nova-compute[74638]:   <mac address="fa:16:3e:46:05:1d"/>
Nov 08 20:08:23 user nova-compute[74638]:   <model type="virtio"/>
Nov 08 20:08:23 user nova-compute[74638]:   <mtu size="1442"/>
Nov 08 20:08:23 user nova-compute[74638]:   <target dev="tapde0772c3-b1"/>
Nov 08 20:08:23 user nova-compute[74638]: </interface>
Nov 08 20:08:23 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No BDM found with device name hda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No VIF found with MAC fa:16:3e:a8:67:68, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-b3b78a9b-b4ea-4938-bb16-166c1be5a1dd req-ce9f5dbe-85d7-4c6d-ad2e-911cb53d831b service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updated VIF entry in instance network info cache for port de0772c3-b1d6-4307-b55c-494418b9437c. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-b3b78a9b-b4ea-4938-bb16-166c1be5a1dd req-ce9f5dbe-85d7-4c6d-ad2e-911cb53d831b service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating instance_info_cache with network_info: [{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:08:24 user nova-compute[74638]:   <nova:package version="0.0.0"/>
Nov 08 20:08:24 user nova-compute[74638]:   <nova:name>tempest-device-tagging-server-1887474706</nova:name>
Nov 08 20:08:24 user nova-compute[74638]:   <nova:creationTime>2023-11-08 20:08:24</nova:creationTime>
Nov 08 20:08:24 user nova-compute[74638]:   <nova:flavor name="m1.tiny">
Nov 08 20:08:24 user nova-compute[74638]:     <nova:memory>512</nova:memory>
Nov 08 20:08:24 user nova-compute[74638]:     <nova:disk>1</nova:disk>
Nov 08 20:08:24 user nova-compute[74638]:     <nova:swap>0</nova:swap>
Nov 08 20:08:24 user nova-compute[74638]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:08:24 user nova-compute[74638]:     <nova:vcpus>1</nova:vcpus>
Nov 08 20:08:24 user nova-compute[74638]:   </nova:flavor>
Nov 08 20:08:24 user nova-compute[74638]:   <nova:owner>
Nov 08 20:08:24 user nova-compute[74638]:     <nova:user uuid="be705289f5974554ab1d6bc4e66735b5">tempest-TaggedAttachmentsTest-929214679-project-member</nova:user>
Nov 08 20:08:24 user nova-compute[74638]:     <nova:project uuid="f83f180c62c64dcb83c30c7e3e8a5c4e">tempest-TaggedAttachmentsTest-929214679</nova:project>
Nov 08 20:08:24 user nova-compute[74638]:   </nova:owner>
Nov 08 20:08:24 user nova-compute[74638]:   <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:08:24 user nova-compute[74638]:   <nova:ports>
Nov 08 20:08:24 user nova-compute[74638]:     <nova:port uuid="18e2eb15-f699-42ac-ac84-e6d446f1f59c">
Nov 08 20:08:24 user nova-compute[74638]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:08:24 user nova-compute[74638]:     </nova:port>
Nov 08 20:08:24 user nova-compute[74638]:     <nova:port uuid="de0772c3-b1d6-4307-b55c-494418b9437c">
Nov 08 20:08:24 user nova-compute[74638]:       <nova:ip type="fixed" address="10.10.10.71" ipVersion="4"/>
Nov 08 20:08:24 user nova-compute[74638]:     </nova:port>
Nov 08 20:08:24 user nova-compute[74638]:   </nova:ports>
Nov 08 20:08:24 user nova-compute[74638]: </nova:instance>
Nov 08 20:08:24 user nova-compute[74638]:  {{(pid=74638) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b3b78a9b-b4ea-4938-bb16-166c1be5a1dd req-ce9f5dbe-85d7-4c6d-ad2e-911cb53d831b service nova] Releasing lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4e15e88a-e35d-4e62-90c8-82558a5c26f1 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "interface-b2192b24-bca8-467c-b408-f6f645d5557f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.803s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] No waiting events found dispatching network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:08:24 user nova-compute[74638]: WARNING nova.compute.manager [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received unexpected event network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c for instance with vm_state active and task_state None.
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] No waiting events found dispatching network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:08:24 user nova-compute[74638]: WARNING nova.compute.manager [req-61055460-cf40-4024-981f-8f073a846004 req-2f35d6ae-e081-44c9-acc2-14b4378252dc service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received unexpected event network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c for instance with vm_state active and task_state None.
Nov 08 20:08:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connector [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Factory for ISCSI on None {{(pid=74638) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXtHhwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:28 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:08:28 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:08:28 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f804b02-16bf-4389-b1b1-8dfc5e8d13f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:08:28 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6012556-f2e0-46b4-84f1-0e02d0bf4528]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219] added
Nov 08 20:08:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d505ae4-dc7d-485e-b48d-2582fa084866]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef62326-8ef2-4b25-b038-3f1666914219]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xXtHhwlU {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xXtHhwlU" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c6ac1-3733-4ea5-8fd5-172bc8172d77]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xXtHhwlU'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f56c73-bcc1-45a4-a124-fc1df2f16c01]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f6ad0b-684d-4bba-9d37-7f0cb7c2a3e3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:08:28 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:08:28 user nova-compute[74638]:  {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:08:28 user nova-compute[74638]: WARNING os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 20:08:28 user nova-compute[74638]: 
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e741e4-fc91-412b-ac05-cd46bf8dafa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219, portal: 172.16.0.220,3260]
Nov 08 20:08:28 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219, portal: 172.16.0.220,3260] successful.
Nov 08 20:08:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[844bc037-bdc5-4bae-abe8-aefffb5289dc]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[73458351-eb03-4a9e-a25b-6af7c2f9af9d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)
Nov 08 20:08:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)
Nov 08 20:08:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff57a5e9-ffca-4cca-b6a4-80d2d1dd0382]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lazy-loading 'flavor' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:29 user nova-compute[74638]: INFO nova.compute.manager [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Attaching volume ae564409-ac3a-40bf-af61-b055a390f446 to /dev/vdb
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.utils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aff9a5-a120-4c26-8592-fc58991786cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[30629360-ff28-4bf7-b22b-257f2cfb8a6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc13cb0-5ded-47cc-a933-1d5611f3331f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30e7c6-c8a5-42aa-897a-bad65dfecc89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:29 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b02de03-791f-41b8-9f4d-fee3e4b6f4df]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.utils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating existing volume attachment record: 44cdb839-e7fe-456f-97b2-6d7305bd895f {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-0bb26476-2e8d-4de0-bdff-38d410e64ca4 req-4f8d338d-f76b-4871-820a-9403f8fc9699 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Received event network-changed-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-0bb26476-2e8d-4de0-bdff-38d410e64ca4 req-4f8d338d-f76b-4871-820a-9403f8fc9699 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Refreshing instance network info cache due to event network-changed-e4be2549-2cdf-4d34-a56f-3ec27579c1c1. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bb26476-2e8d-4de0-bdff-38d410e64ca4 req-4f8d338d-f76b-4871-820a-9403f8fc9699 service nova] Acquiring lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bb26476-2e8d-4de0-bdff-38d410e64ca4 req-4f8d338d-f76b-4871-820a-9403f8fc9699 service nova] Acquired lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-0bb26476-2e8d-4de0-bdff-38d410e64ca4 req-4f8d338d-f76b-4871-820a-9403f8fc9699 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Refreshing network info cache for port e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXtHhwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26539353437633362', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539353437633362', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lazy-loading 'flavor' on Instance uuid 59bd23e8-fb0e-4e75-b03f-a239e068b86d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:08:29 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:08:29 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:08:29 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:08:29 user nova-compute[74638]:   <serial>eb2d7e5c-455e-47e4-9da4-20c1e34bd219</serial>
Nov 08 20:08:29 user nova-compute[74638]: </disk>
Nov 08 20:08:29 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-0bb26476-2e8d-4de0-bdff-38d410e64ca4 req-4f8d338d-f76b-4871-820a-9403f8fc9699 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updated VIF entry in instance network info cache for port e4be2549-2cdf-4d34-a56f-3ec27579c1c1. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-0bb26476-2e8d-4de0-bdff-38d410e64ca4 req-4f8d338d-f76b-4871-820a-9403f8fc9699 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updating instance_info_cache with network_info: [{"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bb26476-2e8d-4de0-bdff-38d410e64ca4 req-4f8d338d-f76b-4871-820a-9403f8fc9699 service nova] Releasing lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] No VIF found with MAC fa:16:3e:8a:da:a2, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-400c4013-660e-4471-9bcf-5b4efbe9dcd3 req-67bc7c5c-6467-4d57-b829-2582c4c8c8e5 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received event network-changed-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-400c4013-660e-4471-9bcf-5b4efbe9dcd3 req-67bc7c5c-6467-4d57-b829-2582c4c8c8e5 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Refreshing instance network info cache due to event network-changed-df85f533-347b-49e1-bab5-5bd28eb584f0. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-400c4013-660e-4471-9bcf-5b4efbe9dcd3 req-67bc7c5c-6467-4d57-b829-2582c4c8c8e5 service nova] Acquiring lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-400c4013-660e-4471-9bcf-5b4efbe9dcd3 req-67bc7c5c-6467-4d57-b829-2582c4c8c8e5 service nova] Acquired lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG nova.network.neutron [req-400c4013-660e-4471-9bcf-5b4efbe9dcd3 req-67bc7c5c-6467-4d57-b829-2582c4c8c8e5 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Refreshing network info cache for port df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG nova.network.neutron [req-400c4013-660e-4471-9bcf-5b4efbe9dcd3 req-67bc7c5c-6467-4d57-b829-2582c4c8c8e5 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Updated VIF entry in instance network info cache for port df85f533-347b-49e1-bab5-5bd28eb584f0. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG nova.network.neutron [req-400c4013-660e-4471-9bcf-5b4efbe9dcd3 req-67bc7c5c-6467-4d57-b829-2582c4c8c8e5 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Updating instance_info_cache with network_info: [{"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-400c4013-660e-4471-9bcf-5b4efbe9dcd3 req-67bc7c5c-6467-4d57-b829-2582c4c8c8e5 service nova] Releasing lock "refresh_cache-03d6123e-19ab-4fcf-9df5-770ca5e30422" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lazy-loading 'flavor' on Instance uuid 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXuNcYHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:47 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:08:47 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:08:47 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[99efe3d4-818a-472e-a947-d8bd28b87acd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:08:47 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbef96fd-9835-4778-89e9-539edf19a997]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92] added
Nov 08 20:08:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9528c2-1107-4413-aa55-94c68715675a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a53f61-ddc7-4ae9-b724-d84737e0a17b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3d0685a1-c198-4c8a-b4bd-17b8d8681e0e tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.633s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXuNcYHs {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXuNcYHs" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3896751a-5d12-4348-829b-77233a71ad94]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FXuNcYHs'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1f6a63-0659-4d3b-bf3f-d9141d48d08b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef2b13-fc01-4f98-afb5-cc5bbf34cf7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)
Nov 08 20:08:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)
Nov 08 20:08:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lazy-loading 'flavor' on Instance uuid 03d6123e-19ab-4fcf-9df5-770ca5e30422 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc68ed7-89e2-4f6d-bbe2-e863dc51d778]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260]
Nov 08 20:08:47 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260] successful.
Nov 08 20:08:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: INFO nova.virt.block_device [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Booting with volume 7fef1b92-755c-45c5-abb1-deae92811bb9 at /dev/vdb
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc9a34f-8f92-4cb3-aa79-fe87b6efc31f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec307186-38ea-4692-9e8c-decb27835292]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)
Nov 08 20:08:47 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:08:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)
Nov 08 20:08:47 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:08:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lazy-loading 'flavor' on Instance uuid e8daf0a9-b049-4dad-8128-cb34cf241da3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3149eb2a-e3bc-4678-a13f-d2fc2eab6bda]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXuNcYHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.utils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[188491d9-61ea-4c63-98d1-020cadc278f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f000d6a4-e6c0-4501-8d90-806868123fee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:47 user nova-compute[74638]: INFO nova.compute.manager [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Attaching volume 9f55b694-5668-468b-87db-dd20af9c0eee to /dev/vdb
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[831151af-bf48-46a9-818e-ca287ed35bfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2485dfe-a607-48b0-8a53-07ac33146174]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:47 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9ad455-0a34-47d8-abc7-106581a8715b]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.utils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating existing volume attachment record: 995b8ee3-3b86-4340-b95d-478cbe9d77e6 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:47 user nova-compute[74638]: INFO nova.compute.manager [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Attaching volume 62794d92-d723-4059-a8e3-720fe7634c0c to /dev/sdc
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:47 user nova-compute[74638]: INFO nova.compute.manager [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Attaching volume 53374af9-d316-49e0-a4c4-687dd9bcea73 to /dev/vdb
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.utils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeff721-66ba-4ecd-abc4-e3cff1bda567]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: INFO nova.compute.manager [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Terminating instance
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b916c887-cf57-4a32-8781-ce09d0e609a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG os_brick.utils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0189a514-743b-4001-8504-d11ca688f946]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2973274-867a-4c3b-8b7a-7022ad9881d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.utils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-02b85465-a9b3-43c6-92fe-a0daee1bd696 req-b256974a-213b-4b57-a6f4-05eca172c32a service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received event network-vif-unplugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-02b85465-a9b3-43c6-92fe-a0daee1bd696 req-b256974a-213b-4b57-a6f4-05eca172c32a service nova] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-02b85465-a9b3-43c6-92fe-a0daee1bd696 req-b256974a-213b-4b57-a6f4-05eca172c32a service nova] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-02b85465-a9b3-43c6-92fe-a0daee1bd696 req-b256974a-213b-4b57-a6f4-05eca172c32a service nova] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-02b85465-a9b3-43c6-92fe-a0daee1bd696 req-b256974a-213b-4b57-a6f4-05eca172c32a service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] No waiting events found dispatching network-vif-unplugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-02b85465-a9b3-43c6-92fe-a0daee1bd696 req-b256974a-213b-4b57-a6f4-05eca172c32a service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received event network-vif-unplugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeb4d48-47d4-45ae-98cb-84f07069973b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa77caa0-df9f-45f8-9a05-30d281992a51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56bb905-560e-4083-908a-053f91147776]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:48 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c290641-9661-49ae-b7af-f570fd302498]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.utils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] <== get_connector_properties: return (514ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updating existing volume attachment record: b821a680-1365-4904-aed3-ce8b6fcdb59f {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2694cf-d626-49e5-896c-38d9791f4a85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba4b5b-5ae8-4ece-9889-8093d2f9fa87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea113475-26e7-48ff-bcb8-c7a805396256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0f5e6d-bc15-4c62-ba05-638ec1b673f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c539b82-369c-4f0c-8a9c-df123fa5b36a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:48 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67d5981-0e13-41c6-9b22-4476ccd7c167]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.utils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] <== get_connector_properties: return (586ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Updating existing volume attachment record: 2ec8ee0c-c4d1-46f4-b968-dc797c20ea95 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:08:48 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c84751-9207-44a0-86f3-a4f1d1c6f0d1]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.utils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] <== get_connector_properties: return (235ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Updating existing volume attachment record: 51e865c8-1dc2-4ef1-9638-cfe5560d52bd {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26531663538656461', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531663538656461', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:08:48 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:08:48 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:08:48 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:08:48 user nova-compute[74638]:   <serial>22b1bf19-c5b4-4f16-8acc-a26cc4177a92</serial>
Nov 08 20:08:48 user nova-compute[74638]: </disk>
Nov 08 20:08:48 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:48 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Instance destroyed successfully.
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lazy-loading 'resources' on Instance uuid 59bd23e8-fb0e-4e75-b03f-a239e068b86d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2089777493',display_name='tempest-DeleteServersTestJSON-server-2089777493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2089777493',id=1,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d8e11b476c42cda1734e93d770bca2',ramdisk_id='',reservation_id='r-36xdptbd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-67210331',owner_user_name='tempest-DeleteServersTestJSON-67210331-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:11Z,user_data=None,user_id='e00b53564f5f40838d0b2bf80703aca3',uuid=59bd23e8-fb0e-4e75-b03f-a239e068b86d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Converting VIF {"id": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "address": "fa:16:3e:8a:da:a2", "network": {"id": "6e3e700d-8446-40ef-b64e-8c24fce40388", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1202810173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d8e11b476c42cda1734e93d770bca2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1c18afc-fb", "ovs_interfaceid": "a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:da:a2,bridge_name='br-int',has_traffic_filtering=True,id=a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587,network=Network(6e3e700d-8446-40ef-b64e-8c24fce40388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c18afc-fb') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_vif [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:da:a2,bridge_name='br-int',has_traffic_filtering=True,id=a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587,network=Network(6e3e700d-8446-40ef-b64e-8c24fce40388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c18afc-fb') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1c18afc-fb, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48efc464-09a5-4dad-b2a2-955e746bfb7f) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:48 user nova-compute[74638]: INFO os_vif [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:da:a2,bridge_name='br-int',has_traffic_filtering=True,id=a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587,network=Network(6e3e700d-8446-40ef-b64e-8c24fce40388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1c18afc-fb')
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXtHhwlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:48 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No VIF found with MAC fa:16:3e:32:99:5e, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8669bf40-2b5f-4a34-8315-1c1998933833]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:08:48 user nova-compute[74638]: No targets found.
Nov 08 20:08:48 user nova-compute[74638]: iSNS:
Nov 08 20:08:48 user nova-compute[74638]: No targets found.
Nov 08 20:08:48 user nova-compute[74638]: STATIC:
Nov 08 20:08:48 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219
Nov 08 20:08:48 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:08:48 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:08:48 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:08:48 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:08:48 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:08:48 user nova-compute[74638]: FIRMWARE:
Nov 08 20:08:48 user nova-compute[74638]: No targets found.
Nov 08 20:08:48 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:08:48 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:08:48 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49752e5-3258-4ae2-8ee7-aba783dd8a26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[47327f09-bf3b-4f8e-8f65-4e010408d711]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)
Nov 08 20:08:49 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:08:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 (non-flash)
Nov 08 20:08:49 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:08:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c012170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c63da5-4624-4855-95e5-90f5908da34a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a7d48f-abc6-4ad4-8a18-06015f32b9ea]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beeae96-3955-458c-ae9d-1f9c1365aad7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[950965ef-1725-4437-9bac-0a97b2a732b8]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f8ddc2-bf9d-4857-8e33-046e8f29eb9e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af0497b-2fb9-485b-a133-aa7a0bba82d7]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219, portal: 172.16.0.220,3260]
Nov 08 20:08:49 user nova-compute[74638]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219, portal: 172.16.0.220,3260] successful.
Nov 08 20:08:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2d7e5c-455e-47e4-9da4-20c1e34bd219 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d25640-19c7-4e48-bdad-e48385e5e115]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] <== disconnect_volume: return (351ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:08:49 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Deleting instance files /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d_del
Nov 08 20:08:49 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Deletion of /opt/stack/data/nova/instances/59bd23e8-fb0e-4e75-b03f-a239e068b86d_del complete
Nov 08 20:08:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74638) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 20:08:49 user nova-compute[74638]: INFO nova.virt.libvirt.host [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] UEFI support detected
Nov 08 20:08:49 user nova-compute[74638]: INFO nova.compute.manager [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 08 20:08:49 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:08:49 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:49 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Took 0.61 seconds to deallocate network for instance.
Nov 08 20:08:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-c4cf701b-5969-428b-8c4a-37bc0edb5505 req-d8aa05cd-d29e-41ce-bafb-c8fe2ab4d905 service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received event network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c4cf701b-5969-428b-8c4a-37bc0edb5505 req-d8aa05cd-d29e-41ce-bafb-c8fe2ab4d905 service nova] Acquiring lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c4cf701b-5969-428b-8c4a-37bc0edb5505 req-d8aa05cd-d29e-41ce-bafb-c8fe2ab4d905 service nova] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c4cf701b-5969-428b-8c4a-37bc0edb5505 req-d8aa05cd-d29e-41ce-bafb-c8fe2ab4d905 service nova] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-c4cf701b-5969-428b-8c4a-37bc0edb5505 req-d8aa05cd-d29e-41ce-bafb-c8fe2ab4d905 service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] No waiting events found dispatching network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:08:50 user nova-compute[74638]: WARNING nova.compute.manager [req-c4cf701b-5969-428b-8c4a-37bc0edb5505 req-d8aa05cd-d29e-41ce-bafb-c8fe2ab4d905 service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received unexpected event network-vif-plugged-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 for instance with vm_state active and task_state deleting.
Nov 08 20:08:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-c4cf701b-5969-428b-8c4a-37bc0edb5505 req-d8aa05cd-d29e-41ce-bafb-c8fe2ab4d905 service nova] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Received event network-vif-deleted-a1c18afc-fbfb-49b9-9f21-9f8dfe9b1587 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:08:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUksidEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:08:53 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:08:53 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:08:53 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef819f53-423e-4939-8bca-42df7d47d679]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:08:53 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea366c-70c2-4950-8ffb-20b20d2d8af3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446] added
Nov 08 20:08:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9174fe49-e71c-41c6-9702-df0ba104a758]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[763392b5-80d7-44de-868d-759bfbfe2fff]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUksidEz {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUksidEz" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c89398-bb6c-4c76-a11b-c126b1a9efc7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DUksidEz'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[17778eee-1d8d-4e5f-a82e-81ed61d0b048]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89ed869-b845-4956-ae4a-6b1aef38d1f6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:08:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:08:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a568b6-7d18-41e4-9823-2444f01569ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446, portal: 172.16.0.220,3260]
Nov 08 20:08:53 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446, portal: 172.16.0.220,3260] successful.
Nov 08 20:08:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11ac7b1-5f33-450b-8f1d-18e960d9066e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[792b3da2-7916-4e66-bcfe-1bcca6007e7f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:08:53 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:08:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:08:53 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:08:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b127ef9-468a-453e-90a3-302bf1e07bfa]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUksidEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:08:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:08:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:08:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23363363961386666', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:08:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363363961386666', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:08:54 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lazy-loading 'flavor' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:08:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:08:54 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:08:54 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:08:54 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:08:54 user nova-compute[74638]:   <serial>ae564409-ac3a-40bf-af61-b055a390f446</serial>
Nov 08 20:08:54 user nova-compute[74638]: </disk>
Nov 08 20:08:54 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:08:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No BDM found with device name hda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:08:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] No VIF found with MAC fa:16:3e:a8:67:68, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:08:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:08:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:08:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:08:57 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updating instance_info_cache with network_info: [{"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-10037bd1-d710-4ce1-abe8-b1f5b657c828" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:08:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:02 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:09:02 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7415MB free_disk=25.580204010009766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 59bd23e8-fb0e-4e75-b03f-a239e068b86d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 10037bd1-d710-4ce1-abe8-b1f5b657c828 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e8daf0a9-b049-4dad-8128-cb34cf241da3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance b2192b24-bca8-467c-b408-f6f645d5557f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 24b78656-ca13-42c8-b45c-e0c1526c1fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a690cfa9-2a34-43a9-843b-e7548703a5e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c73c46a2-e8b7-45a3-89ef-5a90683154b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 204d636f-c342-45df-a083-7aa388a62c54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:09:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:09:03 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:09:03 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:09:03 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:09:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvJQSRod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:09:17 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:09:17 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:09:17 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7101fe2-bcee-4424-91c0-b4408ad5f58a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:09:17 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f9a40b-ed33-4f3a-81bb-d9c05efc9e24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c] added
Nov 08 20:09:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9658e04-e267-4997-9220-cf85122737fd]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[996d9d9b-0743-4ca8-b649-baca36f1ed8d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvJQSRod {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yvJQSRod" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8657213a-2702-48fc-81e9-b714b89559d8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yvJQSRod'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[150ab41b-aba8-49e1-8255-75fd8b5c5897]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9ca7a3-4beb-4bc8-89da-c7b8b8961cdc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:17 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:17 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:09:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc8d65b-a722-42dd-b33f-43fc076b7021]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c, portal: 172.16.0.220,3260]
Nov 08 20:09:18 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c, portal: 172.16.0.220,3260] successful.
Nov 08 20:09:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9079544c-eb10-4510-8492-bfd3c49ad250]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[755eeff9-98b4-4579-9650-f077a7629514]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:18 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:18 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:18 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:18 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4907916-9be9-4da2-a34c-42c3629d96c5]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvJQSRod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:09:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23062643634643862', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062643634643862', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lazy-loading 'flavor' on Instance uuid e8daf0a9-b049-4dad-8128-cb34cf241da3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:09:19 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:19 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:09:19 user nova-compute[74638]:   <target dev="sdc" bus="scsi"/>
Nov 08 20:09:19 user nova-compute[74638]:   <serial>62794d92-d723-4059-a8e3-720fe7634c0c</serial>
Nov 08 20:09:19 user nova-compute[74638]:   <address type="drive" controller="0" unit="2"/>
Nov 08 20:09:19 user nova-compute[74638]: </disk>
Nov 08 20:09:19 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] No BDM found with device name sda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:09:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] No VIF found with MAC fa:16:3e:54:dd:ab, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:09:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:09:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:09:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:09:36 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:09:36 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:09:36 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eddddda-413a-4a9b-a12c-72db7617b567]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:09:36 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb993900-b70e-4e20-bdf5-8558f760b670]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee] added
Nov 08 20:09:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4b15ed-ecdf-4bca-828c-65f6ddfce1a5]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aecccb-f92e-4548-99a9-7bb20d5c06fc]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yuOTNZCB {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yuOTNZCB" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8163ba8b-0aee-4747-9df0-58f83ab59705]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yuOTNZCB'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c0e5b25-45b2-4bdb-a758-e42bdec0f3be tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 92.256s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[55912e4f-5305-4a89-86d3-cb448326850f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ba6053-48ed-4d9f-856f-9dc18ac4bfd1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:36 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:36 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:36 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:36 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ba980b6a-bab2-4a0c-907e-ab9a976a9995 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 67.759s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[65354216-a6ab-4ead-921d-5f49e39da549]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260]
Nov 08 20:09:36 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260] successful.
Nov 08 20:09:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef35a932-d21f-45d2-b14c-74191ca62cde tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.252s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bb11b3-0400-4687-8c48-6e48c07bb48c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:37 user nova-compute[74638]: INFO nova.virt.block_device [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Booting with volume 3ca0a9e4-603e-406f-876a-dadeca621ab1 at /dev/vdc
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[321dcd68-20e5-458b-b217-ad218789943e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:37 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:37 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:37 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:09:37 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:37 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:37 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:37 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:09:37 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce374a-9887-473e-85d4-59575fe262ae]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.utils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a258b-f213-4752-ac74-ed5588fa4530]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-627d4b9e-d8bc-4306-af3a-770fcc4b30b3 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-627d4b9e-d8bc-4306-af3a-770fcc4b30b3 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-627d4b9e-d8bc-4306-af3a-770fcc4b30b3 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0481f3ac-7a3d-4db1-b48e-e0d242d4e660]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-627d4b9e-d8bc-4306-af3a-770fcc4b30b3 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74638) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG nova.objects.instance [None req-627d4b9e-d8bc-4306-af3a-770fcc4b30b3 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c0204d-41b2-4bb6-a525-fb7a0ea86672]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[87629661-2fb1-492f-857b-21a15faa8231]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:09:37 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c3a78f-3008-4350-ab61-28f4d87ecb19]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG os_brick.utils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating existing volume attachment record: 82bb2cff-a422-4ec9-86bf-5b501e33c823 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG nova.compute.manager [req-3cba3541-6145-4926-bbf7-86a80145e565 req-8d53cb80-8bc6-48b5-8596-5dc6a08f19e5 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3cba3541-6145-4926-bbf7-86a80145e565 req-8d53cb80-8bc6-48b5-8596-5dc6a08f19e5 service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3cba3541-6145-4926-bbf7-86a80145e565 req-8d53cb80-8bc6-48b5-8596-5dc6a08f19e5 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3cba3541-6145-4926-bbf7-86a80145e565 req-8d53cb80-8bc6-48b5-8596-5dc6a08f19e5 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:37 user nova-compute[74638]: DEBUG nova.compute.manager [req-3cba3541-6145-4926-bbf7-86a80145e565 req-8d53cb80-8bc6-48b5-8596-5dc6a08f19e5 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:37 user nova-compute[74638]: WARNING nova.compute.manager [req-3cba3541-6145-4926-bbf7-86a80145e565 req-8d53cb80-8bc6-48b5-8596-5dc6a08f19e5 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state active and task_state powering-off.
Nov 08 20:09:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23366633766346565', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366633766346565', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lazy-loading 'flavor' on Instance uuid 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:09:38 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance destroyed successfully.
Nov 08 20:09:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-627d4b9e-d8bc-4306-af3a-770fcc4b30b3 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:09:38 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:38 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:09:38 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:09:38 user nova-compute[74638]:   <serial>9f55b694-5668-468b-87db-dd20af9c0eee</serial>
Nov 08 20:09:38 user nova-compute[74638]: </disk>
Nov 08 20:09:38 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-627d4b9e-d8bc-4306-af3a-770fcc4b30b3 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.971s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] No VIF found with MAC fa:16:3e:dc:97:0f, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:09:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-dce37bad-57b0-46c0-ae12-bf1c2fa78c46 req-a0430b12-4ec7-49a7-9d1c-52c31273f2da service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dce37bad-57b0-46c0-ae12-bf1c2fa78c46 req-a0430b12-4ec7-49a7-9d1c-52c31273f2da service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dce37bad-57b0-46c0-ae12-bf1c2fa78c46 req-a0430b12-4ec7-49a7-9d1c-52c31273f2da service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dce37bad-57b0-46c0-ae12-bf1c2fa78c46 req-a0430b12-4ec7-49a7-9d1c-52c31273f2da service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-dce37bad-57b0-46c0-ae12-bf1c2fa78c46 req-a0430b12-4ec7-49a7-9d1c-52c31273f2da service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:39 user nova-compute[74638]: WARNING nova.compute.manager [req-dce37bad-57b0-46c0-ae12-bf1c2fa78c46 req-a0430b12-4ec7-49a7-9d1c-52c31273f2da service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state stopped and task_state None.
Nov 08 20:09:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:41 user nova-compute[74638]: INFO nova.compute.manager [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Terminating instance
Nov 08 20:09:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-8eba78ee-6460-4824-a0fa-2242066af290 req-c2bdacd5-f3f1-4dc7-8212-5f16d41e4235 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-unplugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8eba78ee-6460-4824-a0fa-2242066af290 req-c2bdacd5-f3f1-4dc7-8212-5f16d41e4235 service nova] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8eba78ee-6460-4824-a0fa-2242066af290 req-c2bdacd5-f3f1-4dc7-8212-5f16d41e4235 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8eba78ee-6460-4824-a0fa-2242066af290 req-c2bdacd5-f3f1-4dc7-8212-5f16d41e4235 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-8eba78ee-6460-4824-a0fa-2242066af290 req-c2bdacd5-f3f1-4dc7-8212-5f16d41e4235 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] No waiting events found dispatching network-vif-unplugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-8eba78ee-6460-4824-a0fa-2242066af290 req-c2bdacd5-f3f1-4dc7-8212-5f16d41e4235 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-unplugged-705c6863-ac49-49b6-b17b-c01584e2232e for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Instance destroyed successfully.
Nov 08 20:09:42 user nova-compute[74638]: DEBUG nova.objects.instance [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lazy-loading 'resources' on Instance uuid c73c46a2-e8b7-45a3-89ef-5a90683154b8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:07:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2013768952',display_name='tempest-ServersNegativeTestJSON-server-2013768952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2013768952',id=11,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:08:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcc60419b64f4d509a058b6ad7c756f6',ramdisk_id='',reservation_id='r-70v5kqwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-300367152',owner_user_name='tempest-ServersNegativeTestJSON-300367152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:08:01Z,user_data=None,user_id='4d337a855b2f47849995109533421233',uuid=c73c46a2-e8b7-45a3-89ef-5a90683154b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converting VIF {"id": "705c6863-ac49-49b6-b17b-c01584e2232e", "address": "fa:16:3e:e5:8d:79", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap705c6863-ac", "ovs_interfaceid": "705c6863-ac49-49b6-b17b-c01584e2232e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:79,bridge_name='br-int',has_traffic_filtering=True,id=705c6863-ac49-49b6-b17b-c01584e2232e,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705c6863-ac') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_vif [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:79,bridge_name='br-int',has_traffic_filtering=True,id=705c6863-ac49-49b6-b17b-c01584e2232e,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705c6863-ac') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap705c6863-ac, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22b1e339-ff12-493f-bcd3-a0d4f8fb2c90) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: INFO os_vif [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:8d:79,bridge_name='br-int',has_traffic_filtering=True,id=705c6863-ac49-49b6-b17b-c01584e2232e,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap705c6863-ac')
Nov 08 20:09:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Deleting instance files /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8_del
Nov 08 20:09:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Deletion of /opt/stack/data/nova/instances/c73c46a2-e8b7-45a3-89ef-5a90683154b8_del complete
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: INFO nova.compute.manager [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYAcIsmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:09:42 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:09:42 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:09:42 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0906e3dd-0bbc-4dca-a727-0515ee0be71c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:09:42 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b65c34-1497-4a1f-a294-8974cb911d78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73] added
Nov 08 20:09:42 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[93933192-a0fa-48d0-ae7b-2202f9eba9d6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[583eca47-4fda-4fb3-bef6-8817b0c76294]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYAcIsmk {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYAcIsmk" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e097dc47-1c3c-4ea0-8113-eefa16b1ab5f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yYAcIsmk'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea1935f-1435-4af2-8a5b-353a119f2253]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ce3b5f-5846-409b-bdba-6caaf4822856]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:42 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:42 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:42 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:09:42 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:42 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:42 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:42 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:09:42 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[890c8683-e8a1-43b1-86b4-b68a331cd816]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73, portal: 172.16.0.220,3260]
Nov 08 20:09:42 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73, portal: 172.16.0.220,3260] successful.
Nov 08 20:09:42 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:42 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3b50ce8b-a8ae-4ae2-91a4-7fc27dec6f68 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.416s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5996a2ec-7ab5-4e1f-a6f2-8ef804f6a6a1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-871a3421-0e52-425d-9512-015cc08276c4 req-7bb2cba1-2e30-4337-a39d-a7f8e9b6a735 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-deleted-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:43 user nova-compute[74638]: INFO nova.compute.manager [req-871a3421-0e52-425d-9512-015cc08276c4 req-7bb2cba1-2e30-4337-a39d-a7f8e9b6a735 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Neutron deleted interface 705c6863-ac49-49b6-b17b-c01584e2232e; detaching it from the instance and deleting it from the info cache
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-871a3421-0e52-425d-9512-015cc08276c4 req-7bb2cba1-2e30-4337-a39d-a7f8e9b6a735 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:43 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Took 0.57 seconds to deallocate network for instance.
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-871a3421-0e52-425d-9512-015cc08276c4 req-7bb2cba1-2e30-4337-a39d-a7f8e9b6a735 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Detach interface failed, port_id=705c6863-ac49-49b6-b17b-c01584e2232e, reason: Instance c73c46a2-e8b7-45a3-89ef-5a90683154b8 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab060b-5415-4624-afb0-24ca14bf9249]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:43 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:43 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:43 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:09:43 user nova-compute[74638]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)
Nov 08 20:09:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:09:43 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:09:43 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:09:43 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:09:43 user nova-compute[74638]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)
Nov 08 20:09:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4570ce8-1f42-4a3e-b8b9-edb18fb927d6]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYAcIsmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:09:43 user nova-compute[74638]: INFO nova.compute.manager [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Detaching volume 62794d92-d723-4059-a8e3-720fe7634c0c
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:43 user nova-compute[74638]: INFO nova.virt.block_device [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Attempting to driver detach volume 62794d92-d723-4059-a8e3-720fe7634c0c from mountpoint /dev/sdc
Nov 08 20:09:43 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Deleted allocations for instance c73c46a2-e8b7-45a3-89ef-5a90683154b8
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Attempting to detach device sdc from instance e8daf0a9-b049-4dad-8128-cb34cf241da3 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:09:43 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:43 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:09:43 user nova-compute[74638]:   <target dev="sdc" bus="scsi"/>
Nov 08 20:09:43 user nova-compute[74638]:   <serial>62794d92-d723-4059-a8e3-720fe7634c0c</serial>
Nov 08 20:09:43 user nova-compute[74638]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 20:09:43 user nova-compute[74638]: </disk>
Nov 08 20:09:43 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:09:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Successfully detached device sdc from instance e8daf0a9-b049-4dad-8128-cb34cf241da3 from the persistent domain config.
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e8daf0a9-b049-4dad-8128-cb34cf241da3 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:09:43 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:43 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:09:43 user nova-compute[74638]:   <target dev="sdc" bus="scsi"/>
Nov 08 20:09:43 user nova-compute[74638]:   <serial>62794d92-d723-4059-a8e3-720fe7634c0c</serial>
Nov 08 20:09:43 user nova-compute[74638]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 20:09:43 user nova-compute[74638]: </disk>
Nov 08 20:09:43 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-128f2bfd-39f3-4219-a2d6-4355f867c400 tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] No waiting events found dispatching network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:43 user nova-compute[74638]: WARNING nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received unexpected event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e for instance with vm_state deleted and task_state None.
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] No waiting events found dispatching network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:43 user nova-compute[74638]: WARNING nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received unexpected event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e for instance with vm_state deleted and task_state None.
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] No waiting events found dispatching network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:43 user nova-compute[74638]: WARNING nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received unexpected event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e for instance with vm_state deleted and task_state None.
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-unplugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] No waiting events found dispatching network-vif-unplugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:43 user nova-compute[74638]: WARNING nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received unexpected event network-vif-unplugged-705c6863-ac49-49b6-b17b-c01584e2232e for instance with vm_state deleted and task_state None.
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Acquiring lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] Lock "c73c46a2-e8b7-45a3-89ef-5a90683154b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] No waiting events found dispatching network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:43 user nova-compute[74638]: WARNING nova.compute.manager [req-8942e7ca-56f1-40e1-a2de-cdb353e544d4 req-175a99e1-c8bb-4917-9ecf-e6836a8d7ac2 service nova] [instance: c73c46a2-e8b7-45a3-89ef-5a90683154b8] Received unexpected event network-vif-plugged-705c6863-ac49-49b6-b17b-c01584e2232e for instance with vm_state deleted and task_state None.
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:43 user nova-compute[74638]: INFO nova.compute.manager [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Detaching volume ae564409-ac3a-40bf-af61-b055a390f446
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e8daf0a9-b049-4dad-8128-cb34cf241da3 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23661393363383438', 'path': '/dev/sdf'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661393363383438', 'path': '/dev/sdf'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lazy-loading 'flavor' on Instance uuid 03d6123e-19ab-4fcf-9df5-770ca5e30422 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:09:44 user nova-compute[74638]: INFO nova.virt.block_device [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Attempting to driver detach volume ae564409-ac3a-40bf-af61-b055a390f446 from mountpoint /dev/vdb
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] attach device xml: <disk type="block" device="disk">
Nov 08 20:09:44 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:44 user nova-compute[74638]:   <source dev="/dev/sdf"/>
Nov 08 20:09:44 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:09:44 user nova-compute[74638]:   <serial>53374af9-d316-49e0-a4c4-687dd9bcea73</serial>
Nov 08 20:09:44 user nova-compute[74638]: </disk>
Nov 08 20:09:44 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Attempting to detach device vdb from instance b2192b24-bca8-467c-b408-f6f645d5557f from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:09:44 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:44 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:09:44 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:09:44 user nova-compute[74638]:   <serial>ae564409-ac3a-40bf-af61-b055a390f446</serial>
Nov 08 20:09:44 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 20:09:44 user nova-compute[74638]: </disk>
Nov 08 20:09:44 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:09:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Successfully detached device vdb from instance b2192b24-bca8-467c-b408-f6f645d5557f from the persistent domain config.
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2192b24-bca8-467c-b408-f6f645d5557f from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:09:44 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:44 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:09:44 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:09:44 user nova-compute[74638]:   <serial>ae564409-ac3a-40bf-af61-b055a390f446</serial>
Nov 08 20:09:44 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 20:09:44 user nova-compute[74638]: </disk>
Nov 08 20:09:44 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] No VIF found with MAC fa:16:3e:2e:e4:84, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG os_brick.utils [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0766976a-b832-41d2-b4ab-8613bfee242b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa29c80a-dccb-4c5f-8f43-139c75520875]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f7265e-445e-49f4-ac87-e14e90041553]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f728c093-5f9b-4755-b971-6f876fb21300]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:09:44 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[019e748f-f86a-452d-babc-4f193f1b4824]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG os_brick.utils [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f579c58f-3dd7-4369-bf7e-ca86092b6a06 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.032s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:09:44 user nova-compute[74638]: INFO nova.compute.manager [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Swapping volume 9f55b694-5668-468b-87db-dd20af9c0eee for de3f1df7-03b4-46f8-b7fe-77402aa88e05
Nov 08 20:09:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:49 user nova-compute[74638]: INFO nova.compute.manager [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] [instance: 59bd23e8-fb0e-4e75-b03f-a239e068b86d] Took 59.45 seconds to detach 1 volumes for instance.
Nov 08 20:09:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:49 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:09:49 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:09:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:49 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Deleted allocations for instance 59bd23e8-fb0e-4e75-b03f-a239e068b86d
Nov 08 20:09:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c1774ad7-2611-46ab-9ae2-3ca652534bc4 tempest-DeleteServersTestJSON-67210331 tempest-DeleteServersTestJSON-67210331-project-member] Lock "59bd23e8-fb0e-4e75-b03f-a239e068b86d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 62.284s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a8fd4a77-38c5-4c17-843e-7f6d1ab2204b tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] volume_snapshot_create: create_info: {'snapshot_id': '94286825-c927-4556-a602-275f84ca48b5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74638) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 08 20:09:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a8fd4a77-38c5-4c17-843e-7f6d1ab2204b tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] snap xml: <domainsnapshot>
Nov 08 20:09:50 user nova-compute[74638]:   <disks>
Nov 08 20:09:50 user nova-compute[74638]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 08 20:09:50 user nova-compute[74638]:       <source file="/dev/new_file"/>
Nov 08 20:09:50 user nova-compute[74638]:     </disk>
Nov 08 20:09:50 user nova-compute[74638]:     <disk name="vda" snapshot="no"/>
Nov 08 20:09:50 user nova-compute[74638]:   </disks>
Nov 08 20:09:50 user nova-compute[74638]: </domainsnapshot>
Nov 08 20:09:50 user nova-compute[74638]:  {{(pid=74638) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 08 20:09:50 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a8fd4a77-38c5-4c17-843e-7f6d1ab2204b tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] Lazy-loading 'system_metadata' on Instance uuid 03d6123e-19ab-4fcf-9df5-770ca5e30422 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:09:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a8fd4a77-38c5-4c17-843e-7f6d1ab2204b tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 20:09:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7261b277-510a-4e13-93f1-165c54a5f737 tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] volume_snapshot_delete: delete_info: {'volume_id': '53374af9-d316-49e0-a4c4-687dd9bcea73'} {{(pid=74638) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [None req-7261b277-510a-4e13-93f1-165c54a5f737 tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     if delete_info['type'] != 'qcow2':
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] KeyError: 'type'
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [None req-a8fd4a77-38c5-4c17-843e-7f6d1ab2204b tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     rv = execute(f, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     six.reraise(c, e, tb)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     raise value
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     rv = meth(*args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [None req-a8fd4a77-38c5-4c17-843e-7f6d1ab2204b tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     self._volume_snapshot_create(context, instance, guest,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     rv = execute(f, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     six.reraise(c, e, tb)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     raise value
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     rv = meth(*args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [None req-7261b277-510a-4e13-93f1-165c54a5f737 tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-88adc42c-4cdc-4e68-ab1a-88d37aac1c7c)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver [None req-a8fd4a77-38c5-4c17-843e-7f6d1ab2204b tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 94286825-c927-4556-a602-275f84ca48b5 could not be found.
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     raise value
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 94286825-c927-4556-a602-275f84ca48b5 could not be found. (HTTP 404) (Request-ID: req-9e37f068-87f9-4be3-b1fe-18bd040ddcc4)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 94286825-c927-4556-a602-275f84ca48b5 could not be found.
Nov 08 20:09:50 user nova-compute[74638]: ERROR nova.virt.libvirt.driver 
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server [None req-7261b277-510a-4e13-93f1-165c54a5f737 tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] Exception during message handling: KeyError: 'type'
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server 
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server [None req-a8fd4a77-38c5-4c17-843e-7f6d1ab2204b tempest-VolumesAssistedSnapshotsTest-517578598 tempest-VolumesAssistedSnapshotsTest-517578598-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise value
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 20:09:50 user nova-compute[74638]: ERROR oslo_messaging.rpc.server 
Nov 08 20:09:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:50 user nova-compute[74638]: INFO nova.compute.manager [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Detaching volume 53374af9-d316-49e0-a4c4-687dd9bcea73
Nov 08 20:09:51 user nova-compute[74638]: INFO nova.virt.block_device [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Attempting to driver detach volume 53374af9-d316-49e0-a4c4-687dd9bcea73 from mountpoint /dev/vdb
Nov 08 20:09:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Attempting to detach device vdb from instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:09:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 20:09:51 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:51 user nova-compute[74638]:   <source dev="/dev/sdf"/>
Nov 08 20:09:51 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:09:51 user nova-compute[74638]:   <serial>53374af9-d316-49e0-a4c4-687dd9bcea73</serial>
Nov 08 20:09:51 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:09:51 user nova-compute[74638]: </disk>
Nov 08 20:09:51 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:09:51 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Successfully detached device vdb from instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 from the persistent domain config.
Nov 08 20:09:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:09:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 20:09:51 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:09:51 user nova-compute[74638]:   <source dev="/dev/sdf"/>
Nov 08 20:09:51 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:09:51 user nova-compute[74638]:   <serial>53374af9-d316-49e0-a4c4-687dd9bcea73</serial>
Nov 08 20:09:51 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:09:51 user nova-compute[74638]: </disk>
Nov 08 20:09:51 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:09:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:09:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:09:53 user nova-compute[74638]: INFO nova.compute.claims [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Claim successful on node user
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.network.neutron [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:09:53 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:09:53 user nova-compute[74638]: DEBUG nova.policy [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc302495f45a4ae1bd2524aa60ecbc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0b2492206349f197739ee10c95a28f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:09:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Creating image(s)
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating instance_info_cache with network_info: [{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk 1073741824" returned: 0 in 0.063s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.network.neutron [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Successfully created port: 36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.267s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Cannot resize image /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Ensure instance console log exists: /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Successfully updated port: 36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquired lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-437d07bd-1e3f-47bc-bea2-edc784b11724 req-977a6098-72b5-4c43-b9ee-e1ae4f3a1949 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-changed-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-437d07bd-1e3f-47bc-bea2-edc784b11724 req-977a6098-72b5-4c43-b9ee-e1ae4f3a1949 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Refreshing instance network info cache due to event network-changed-36206fb4-fe9a-400f-90ff-cc2657e78bda. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-437d07bd-1e3f-47bc-bea2-edc784b11724 req-977a6098-72b5-4c43-b9ee-e1ae4f3a1949 service nova] Acquiring lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.network.neutron [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updating instance_info_cache with network_info: [{"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Releasing lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance network_info: |[{"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-437d07bd-1e3f-47bc-bea2-edc784b11724 req-977a6098-72b5-4c43-b9ee-e1ae4f3a1949 service nova] Acquired lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-437d07bd-1e3f-47bc-bea2-edc784b11724 req-977a6098-72b5-4c43-b9ee-e1ae4f3a1949 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Refreshing network info cache for port 36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Start _get_guest_xml network_info=[{"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:09:56 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:09:56 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-116077949',display_name='tempest-tempest.common.compute-instance-116077949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-116077949',id=13,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi+eiPDqr6HlSxIQXH10Azfpx5sZFk+jXLb7JAwxAhz2gsJtoPLkM7/afKnSfkwD64rnPqNXm5hNSYOOnXFXGL2P8MItyH/1MyEiogdDVC1Nfak4q9GTrUuVYpG2ko6aA==',key_name='tempest-keypair-253147816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-wsqgnlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=a8f5663b-ac6f-4037-96c8-94152295e07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'pci_devices' on Instance uuid a8f5663b-ac6f-4037-96c8-94152295e07e {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:09:56 user nova-compute[74638]:   <uuid>a8f5663b-ac6f-4037-96c8-94152295e07e</uuid>
Nov 08 20:09:56 user nova-compute[74638]:   <name>instance-0000000d</name>
Nov 08 20:09:56 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:09:56 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:09:56 user nova-compute[74638]:   <metadata>
Nov 08 20:09:56 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:09:56 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:09:56 user nova-compute[74638]:       <nova:name>tempest-tempest.common.compute-instance-116077949</nova:name>
Nov 08 20:09:56 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:09:56</nova:creationTime>
Nov 08 20:09:56 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:09:56 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:09:56 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:09:56 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:09:56 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:09:56 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:09:56 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:09:56 user nova-compute[74638]:       <nova:owner>
Nov 08 20:09:56 user nova-compute[74638]:         <nova:user uuid="fc302495f45a4ae1bd2524aa60ecbc85">tempest-ServerActionsTestOtherA-1281886616-project-member</nova:user>
Nov 08 20:09:56 user nova-compute[74638]:         <nova:project uuid="4d0b2492206349f197739ee10c95a28f">tempest-ServerActionsTestOtherA-1281886616</nova:project>
Nov 08 20:09:56 user nova-compute[74638]:       </nova:owner>
Nov 08 20:09:56 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:09:56 user nova-compute[74638]:       <nova:ports>
Nov 08 20:09:56 user nova-compute[74638]:         <nova:port uuid="36206fb4-fe9a-400f-90ff-cc2657e78bda">
Nov 08 20:09:56 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 20:09:56 user nova-compute[74638]:         </nova:port>
Nov 08 20:09:56 user nova-compute[74638]:       </nova:ports>
Nov 08 20:09:56 user nova-compute[74638]:     </nova:instance>
Nov 08 20:09:56 user nova-compute[74638]:   </metadata>
Nov 08 20:09:56 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:09:56 user nova-compute[74638]:     <system>
Nov 08 20:09:56 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:09:56 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:09:56 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:09:56 user nova-compute[74638]:       <entry name="serial">a8f5663b-ac6f-4037-96c8-94152295e07e</entry>
Nov 08 20:09:56 user nova-compute[74638]:       <entry name="uuid">a8f5663b-ac6f-4037-96c8-94152295e07e</entry>
Nov 08 20:09:56 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:09:56 user nova-compute[74638]:     </system>
Nov 08 20:09:56 user nova-compute[74638]:   </sysinfo>
Nov 08 20:09:56 user nova-compute[74638]:   <os>
Nov 08 20:09:56 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:09:56 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:09:56 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:09:56 user nova-compute[74638]:   </os>
Nov 08 20:09:56 user nova-compute[74638]:   <features>
Nov 08 20:09:56 user nova-compute[74638]:     <acpi/>
Nov 08 20:09:56 user nova-compute[74638]:     <apic/>
Nov 08 20:09:56 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:09:56 user nova-compute[74638]:   </features>
Nov 08 20:09:56 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:09:56 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:09:56 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:09:56 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:09:56 user nova-compute[74638]:   </clock>
Nov 08 20:09:56 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:09:56 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:09:56 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:09:56 user nova-compute[74638]:   </cpu>
Nov 08 20:09:56 user nova-compute[74638]:   <devices>
Nov 08 20:09:56 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:09:56 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:09:56 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk"/>
Nov 08 20:09:56 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:09:56 user nova-compute[74638]:     </disk>
Nov 08 20:09:56 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:09:56 user nova-compute[74638]:       <mac address="fa:16:3e:63:61:cb"/>
Nov 08 20:09:56 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:09:56 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:09:56 user nova-compute[74638]:       <target dev="tap36206fb4-fe"/>
Nov 08 20:09:56 user nova-compute[74638]:     </interface>
Nov 08 20:09:56 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:09:56 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/console.log" append="off"/>
Nov 08 20:09:56 user nova-compute[74638]:     </serial>
Nov 08 20:09:56 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:09:56 user nova-compute[74638]:     <video>
Nov 08 20:09:56 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:09:56 user nova-compute[74638]:     </video>
Nov 08 20:09:56 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:09:56 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:09:56 user nova-compute[74638]:     </rng>
Nov 08 20:09:56 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:09:56 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:09:56 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:09:56 user nova-compute[74638]:     </memballoon>
Nov 08 20:09:56 user nova-compute[74638]:   </devices>
Nov 08 20:09:56 user nova-compute[74638]: </domain>
Nov 08 20:09:56 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-116077949',display_name='tempest-tempest.common.compute-instance-116077949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-116077949',id=13,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi+eiPDqr6HlSxIQXH10Azfpx5sZFk+jXLb7JAwxAhz2gsJtoPLkM7/afKnSfkwD64rnPqNXm5hNSYOOnXFXGL2P8MItyH/1MyEiogdDVC1Nfak4q9GTrUuVYpG2ko6aA==',key_name='tempest-keypair-253147816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-wsqgnlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:09:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=a8f5663b-ac6f-4037-96c8-94152295e07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG os_vif [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6808b1d4-c1c8-5e40-a81c-3f9df3f99b1d', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lazy-loading 'flavor' on Instance uuid 10037bd1-d710-4ce1-abe8-b1f5b657c828 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36206fb4-fe, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36206fb4-fe, col_values=(('qos', UUID('e8e8aafd-537c-4aa3-a7ce-aff3d4f3a4a7')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36206fb4-fe, col_values=(('external_ids', {'iface-id': '36206fb4-fe9a-400f-90ff-cc2657e78bda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:61:cb', 'vm-uuid': 'a8f5663b-ac6f-4037-96c8-94152295e07e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:56 user nova-compute[74638]: INFO os_vif [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe')
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No VIF found with MAC fa:16:3e:63:61:cb, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:56 user nova-compute[74638]: INFO nova.compute.manager [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Attaching volume 6f9209b9-6383-4937-8742-e135adbc6a76 to /dev/vdb
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-437d07bd-1e3f-47bc-bea2-edc784b11724 req-977a6098-72b5-4c43-b9ee-e1ae4f3a1949 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updated VIF entry in instance network info cache for port 36206fb4-fe9a-400f-90ff-cc2657e78bda. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-437d07bd-1e3f-47bc-bea2-edc784b11724 req-977a6098-72b5-4c43-b9ee-e1ae4f3a1949 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updating instance_info_cache with network_info: [{"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-437d07bd-1e3f-47bc-bea2-edc784b11724 req-977a6098-72b5-4c43-b9ee-e1ae4f3a1949 service nova] Releasing lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG os_brick.utils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf637dc-5278-4731-9e1b-d0dd2fd0890a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1acef6d-17bd-4413-99a6-18856cb4ac45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc4ea8-0407-448a-8407-900caf8d5945]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa56f9-8b29-4fd5-9d52-52d86570ae04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:09:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:09:57 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4275100a-cdae-47e5-8141-c7d2a5d14bf2]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG os_brick.utils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updating existing volume attachment record: 70d532b4-85d8-4e5f-bb37-69152334ff13 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-03bb4f02-d806-493d-92c5-7fd75169f7b1 req-4c14ebdc-a560-405c-abc4-ab26c719470e service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-03bb4f02-d806-493d-92c5-7fd75169f7b1 req-4c14ebdc-a560-405c-abc4-ab26c719470e service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-03bb4f02-d806-493d-92c5-7fd75169f7b1 req-4c14ebdc-a560-405c-abc4-ab26c719470e service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-03bb4f02-d806-493d-92c5-7fd75169f7b1 req-4c14ebdc-a560-405c-abc4-ab26c719470e service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-03bb4f02-d806-493d-92c5-7fd75169f7b1 req-4c14ebdc-a560-405c-abc4-ab26c719470e service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:09:58 user nova-compute[74638]: WARNING nova.compute.manager [req-03bb4f02-d806-493d-92c5-7fd75169f7b1 req-4c14ebdc-a560-405c-abc4-ab26c719470e service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state building and task_state spawning.
Nov 08 20:09:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:09:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:09:59 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:09:59 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7998MB free_disk=25.60540771484375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 10037bd1-d710-4ce1-abe8-b1f5b657c828 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e8daf0a9-b049-4dad-8128-cb34cf241da3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance b2192b24-bca8-467c-b408-f6f645d5557f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 24b78656-ca13-42c8-b45c-e0c1526c1fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a690cfa9-2a34-43a9-843b-e7548703a5e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 204d636f-c342-45df-a083-7aa388a62c54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a8f5663b-ac6f-4037-96c8-94152295e07e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:09:59 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-d677a2b2-3a21-4872-98ee-c9c98ad5e3fe req-db524a94-329b-4492-a1f1-6de613ed6dcf service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d677a2b2-3a21-4872-98ee-c9c98ad5e3fe req-db524a94-329b-4492-a1f1-6de613ed6dcf service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d677a2b2-3a21-4872-98ee-c9c98ad5e3fe req-db524a94-329b-4492-a1f1-6de613ed6dcf service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d677a2b2-3a21-4872-98ee-c9c98ad5e3fe req-db524a94-329b-4492-a1f1-6de613ed6dcf service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-d677a2b2-3a21-4872-98ee-c9c98ad5e3fe req-db524a94-329b-4492-a1f1-6de613ed6dcf service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:00 user nova-compute[74638]: WARNING nova.compute.manager [req-d677a2b2-3a21-4872-98ee-c9c98ad5e3fe req-db524a94-329b-4492-a1f1-6de613ed6dcf service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state building and task_state spawning.
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:10:00 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance spawned successfully.
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-086ab4c9-2a6b-497e-beb1-daeb6d30359b req-dff4111e-cbcd-4770-9be9-9418161fbe59 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received event network-changed-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-086ab4c9-2a6b-497e-beb1-daeb6d30359b req-dff4111e-cbcd-4770-9be9-9418161fbe59 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Refreshing instance network info cache due to event network-changed-57b2113f-dc55-4a33-9bd0-965a4eae35dd. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-086ab4c9-2a6b-497e-beb1-daeb6d30359b req-dff4111e-cbcd-4770-9be9-9418161fbe59 service nova] Acquiring lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-086ab4c9-2a6b-497e-beb1-daeb6d30359b req-dff4111e-cbcd-4770-9be9-9418161fbe59 service nova] Acquired lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.network.neutron [req-086ab4c9-2a6b-497e-beb1-daeb6d30359b req-dff4111e-cbcd-4770-9be9-9418161fbe59 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Refreshing network info cache for port 57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:10:00 user nova-compute[74638]: INFO nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:10:00 user nova-compute[74638]: INFO nova.compute.manager [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Took 7.54 seconds to build instance.
Nov 08 20:10:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5192b470-996c-4630-a149-51520033e65a tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.666s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.network.neutron [req-086ab4c9-2a6b-497e-beb1-daeb6d30359b req-dff4111e-cbcd-4770-9be9-9418161fbe59 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Updated VIF entry in instance network info cache for port 57b2113f-dc55-4a33-9bd0-965a4eae35dd. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:10:00 user nova-compute[74638]: DEBUG nova.network.neutron [req-086ab4c9-2a6b-497e-beb1-daeb6d30359b req-dff4111e-cbcd-4770-9be9-9418161fbe59 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Updating instance_info_cache with network_info: [{"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:10:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-086ab4c9-2a6b-497e-beb1-daeb6d30359b req-dff4111e-cbcd-4770-9be9-9418161fbe59 service nova] Releasing lock "refresh_cache-204d636f-c342-45df-a083-7aa388a62c54" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:10:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:04 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e8daf0a9-b049-4dad-8128-cb34cf241da3 is timed out.
Nov 08 20:10:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Successfully detached device sdc from instance e8daf0a9-b049-4dad-8128-cb34cf241da3 from the live domain config.
Nov 08 20:10:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yvJQSRod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:04 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd352f-f517-465e-80bd-da752fb59379]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:10:04 user nova-compute[74638]: No targets found.
Nov 08 20:10:04 user nova-compute[74638]: iSNS:
Nov 08 20:10:04 user nova-compute[74638]: No targets found.
Nov 08 20:10:04 user nova-compute[74638]: STATIC:
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: FIRMWARE:
Nov 08 20:10:04 user nova-compute[74638]: No targets found.
Nov 08 20:10:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:10:04 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:10:04 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[849d809a-aeec-4597-a9f2-a4e498b1d089]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565d7ca-d328-457c-8c08-9c73c3588c28]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c2ad090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b749ae-563e-447b-9573-048743ba2e26]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[67793210-7018-4843-a266-ca30e3aa2ba9]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee2ceb-697d-40e3-a639-3ee9c022b202]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e79b11-ff29-461b-9062-93af0dde33f1]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3013d-25bc-4ebb-bbba-9b3d59aa8b9a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8909cc3d-6667-4a6f-b867-7bac6a267681]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c, portal: 172.16.0.220,3260]
Nov 08 20:10:04 user nova-compute[74638]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62794d92-d723-4059-a8e3-720fe7634c0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb65dec2-4c50-4128-8130-1f73e82ed926]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] <== disconnect_volume: return (363ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:10:04 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2192b24-bca8-467c-b408-f6f645d5557f is timed out.
Nov 08 20:10:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Successfully detached device vdb from instance b2192b24-bca8-467c-b408-f6f645d5557f from the live domain config.
Nov 08 20:10:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUksidEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:04 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19303d-7236-4124-b0d6-c1a71e152e5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:10:04 user nova-compute[74638]: No targets found.
Nov 08 20:10:04 user nova-compute[74638]: iSNS:
Nov 08 20:10:04 user nova-compute[74638]: No targets found.
Nov 08 20:10:04 user nova-compute[74638]: STATIC:
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:10:04 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:04 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:04 user nova-compute[74638]: FIRMWARE:
Nov 08 20:10:04 user nova-compute[74638]: No targets found.
Nov 08 20:10:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:10:04 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:10:04 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8ed0b5-edd0-41cb-b891-5a3d809a976f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7305cf-45be-4b74-b24d-4afd2b1cae41]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:04 user nova-compute[74638]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)
Nov 08 20:10:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c2ac430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea47fcfa-9d59-45ea-b650-6d1c8f412989]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84ec405-7653-4c68-b059-576e30f9cb8b]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8180ce0f-7d33-43ca-ac82-61ea60757aec]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:10:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fea0477-b8ef-49af-bef4-963f3b1a9079]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d15ea1c-7a0f-49a9-92b7-87f93f9c7f64]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[374505d0-c5a2-44c2-a1ca-7536bf5e3d40]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446, portal: 172.16.0.220,3260]
Nov 08 20:10:05 user nova-compute[74638]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae564409-ac3a-40bf-af61-b055a390f446 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d276057b-a9d9-4b3b-a3c5-58b8a451c5f0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] <== disconnect_volume: return (330ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:10:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:11 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 is timed out.
Nov 08 20:10:11 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Successfully detached device vdb from instance 03d6123e-19ab-4fcf-9df5-770ca5e30422 from the live domain config.
Nov 08 20:10:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYAcIsmk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:11 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafaaba8-a646-4d07-bfef-99167bbad3ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:10:11 user nova-compute[74638]: No targets found.
Nov 08 20:10:11 user nova-compute[74638]: iSNS:
Nov 08 20:10:11 user nova-compute[74638]: No targets found.
Nov 08 20:10:11 user nova-compute[74638]: STATIC:
Nov 08 20:10:11 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:10:11 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:11 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:11 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73
Nov 08 20:10:11 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:11 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:11 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:10:11 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:11 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:11 user nova-compute[74638]: FIRMWARE:
Nov 08 20:10:11 user nova-compute[74638]: No targets found.
Nov 08 20:10:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:10:11 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:10:11 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e048fef0-8261-46cd-8a24-b3b8e6c04ab3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d0d5c-7c53-439c-9dfc-5e75df2888a6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:11 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:11 user nova-compute[74638]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)
Nov 08 20:10:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:11 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:11 user nova-compute[74638]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 (non-flash)
Nov 08 20:10:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c5cb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73'): ({'sdf'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Removing single pathed devices sdf {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec9dc5-9db5-4d21-8425-b7c42628923e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ef8b7-623d-4599-b095-d45b20cdbd72]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Flushing IO for device /dev/sdf {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[48891989-6ede-4f32-ae2e-e2bdf2da344c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a322d0-8518-4201-b7bf-402f3745d12d]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] SCSI volumes sdf have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5671d42c-213e-44e4-a0b1-50be70f152fa]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[79193b6c-e76e-4096-b23e-7cbdf1d85d36]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73, portal: 172.16.0.220,3260]
Nov 08 20:10:11 user nova-compute[74638]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53374af9-d316-49e0-a4c4-687dd9bcea73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[02673b4f-87ac-47e6-b8a4-2cae78ff5a58]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] <== disconnect_volume: return (286ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKhUgmHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24b78656-ca13-42c8-b45c-e0c1526c1fee', 'attached_at': '', 'detached_at': '', 'volume_id': 'de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'serial': 'de3f1df7-03b4-46f8-b7fe-77402aa88e05'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '24b78656-ca13-42c8-b45c-e0c1526c1fee', 'attached_at': '', 'detached_at': '', 'volume_id': '9f55b694-5668-468b-87db-dd20af9c0eee', 'serial'} {{(pid=74638) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKhUgmHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:12 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:12 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:12 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[04765719-acdf-4426-8101-3e27aaf974ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:10:12 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab3d6a8-0882-467e-8d1f-7fd885486bde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05] added
Nov 08 20:10:12 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc24dba-fe18-440a-aeaf-fd30f9f77e47]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[efac1561-f78b-4d34-9401-a77b46dfbd7a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CKhUgmHz {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CKhUgmHz" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb6f73-7c59-4428-9813-a23dd91ac64e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CKhUgmHz'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94efb20-1a2e-48dc-b87e-e3be36872f13]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5857d77-e926-4e05-ac6a-04e9e8d03ff7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:13 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:13 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc3db42-d2aa-4271-bb1d-2166648fd29a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05, portal: 172.16.0.220,3260]
Nov 08 20:10:13 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dd2259-7ccc-4247-8d09-00570fa04cf5]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[691d6ccb-0ed0-4cfe-81d8-d67cd74fbd4c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:13 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:13 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:13 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:13 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b903a15-1f36-4bf4-ad72-f21f8a7ac77b]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG nova.objects.instance [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lazy-loading 'flavor' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8a1e1d0-1397-4b9f-ba47-e212328bf854 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.053s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:10:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Creating image(s)
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Ensure instance console log exists: /opt/stack/data/nova/instances/a690cfa9-2a34-43a9-843b-e7548703a5e3/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Start _get_guest_xml network_info=[{"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '49106e3d-080b-4c8f-8133-c47e3f772552', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMGdizJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a690cfa9-2a34-43a9-843b-e7548703a5e3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf', 'serial': 'a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '995b8ee3-3b86-4340-b95d-478cbe9d77e6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxkJfDHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a690cfa9-2a34-43a9-843b-e7548703a5e3', 'attached_at': '', 'detached_at': '', 'volume_id': '7fef1b92-755c-45c5-abb1-deae92811bb9', 'serial': '7fef1b92-755c-45c5-abb1-deae92811bb9'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '82bb2cff-a422-4ec9-86bf-5b501e33c823', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrpAdvqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a690cfa9-2a34-43a9-843b-e7548703a5e3', 'attached_at': '', 'detached_at': '', 'volume_id': '3ca0a9e4-603e-406f-876a-dadeca621ab1', 'serial': '3ca0a9e4-603e-406f-876a-dadeca621ab1'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:10:14 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:10:14 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMGdizJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:14 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKhUgmHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26161313730303533', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313730303533', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.055s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:14 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:14 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "interface-b2192b24-bca8-467c-b408-f6f645d5557f-de0772c3-b1d6-4307-b55c-494418b9437c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "interface-b2192b24-bca8-467c-b408-f6f645d5557f-de0772c3-b1d6-4307-b55c-494418b9437c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lazy-loading 'flavor' on Instance uuid 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.objects.instance [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lazy-loading 'flavor' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97712eb-7552-45ce-b9d3-a6cde0a6b0fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:10:14 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converting VIF {"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb07ce1-8b12-4fef-bd37-7b539b8bd663]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf] added
Nov 08 20:10:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface> {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface> {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Attempting to detach device tapde0772c3-b1 from instance b2192b24-bca8-467c-b408-f6f645d5557f from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] detach device xml: <interface type="ethernet">
Nov 08 20:10:14 user nova-compute[74638]:   <mac address="fa:16:3e:46:05:1d"/>
Nov 08 20:10:14 user nova-compute[74638]:   <model type="virtio"/>
Nov 08 20:10:14 user nova-compute[74638]:   <mtu size="1442"/>
Nov 08 20:10:14 user nova-compute[74638]:   <target dev="tapde0772c3-b1"/>
Nov 08 20:10:14 user nova-compute[74638]: </interface>
Nov 08 20:10:14 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eaae83-4c1d-4194-8783-b6057eef4894]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bd5f3f-44b6-4682-9e80-d9bef447d2c2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface> {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMGdizJn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 20:10:14 user nova-compute[74638]:   <name>instance-00000007</name>
Nov 08 20:10:14 user nova-compute[74638]:   <uuid>b2192b24-bca8-467c-b408-f6f645d5557f</uuid>
Nov 08 20:10:14 user nova-compute[74638]:   <metadata>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:10:14 user nova-compute[74638]:   <nova:package version="0.0.0"/>
Nov 08 20:10:14 user nova-compute[74638]:   <nova:name>tempest-device-tagging-server-1887474706</nova:name>
Nov 08 20:10:14 user nova-compute[74638]:   <nova:creationTime>2023-11-08 20:08:24</nova:creationTime>
Nov 08 20:10:14 user nova-compute[74638]:   <nova:flavor name="m1.tiny">
Nov 08 20:10:14 user nova-compute[74638]:     <nova:memory>512</nova:memory>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:disk>1</nova:disk>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:swap>0</nova:swap>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:vcpus>1</nova:vcpus>
Nov 08 20:10:14 user nova-compute[74638]:   </nova:flavor>
Nov 08 20:10:14 user nova-compute[74638]:   <nova:owner>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:user uuid="be705289f5974554ab1d6bc4e66735b5">tempest-TaggedAttachmentsTest-929214679-project-member</nova:user>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:project uuid="f83f180c62c64dcb83c30c7e3e8a5c4e">tempest-TaggedAttachmentsTest-929214679</nova:project>
Nov 08 20:10:14 user nova-compute[74638]:   </nova:owner>
Nov 08 20:10:14 user nova-compute[74638]:   <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:10:14 user nova-compute[74638]:   <nova:ports>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:port uuid="18e2eb15-f699-42ac-ac84-e6d446f1f59c">
Nov 08 20:10:14 user nova-compute[74638]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:10:14 user nova-compute[74638]:     </nova:port>
Nov 08 20:10:14 user nova-compute[74638]:     <nova:port uuid="de0772c3-b1d6-4307-b55c-494418b9437c">
Nov 08 20:10:14 user nova-compute[74638]:       <nova:ip type="fixed" address="10.10.10.71" ipVersion="4"/>
Nov 08 20:10:14 user nova-compute[74638]:     </nova:port>
Nov 08 20:10:14 user nova-compute[74638]:   </nova:ports>
Nov 08 20:10:14 user nova-compute[74638]: </nova:instance>
Nov 08 20:10:14 user nova-compute[74638]:   </metadata>
Nov 08 20:10:14 user nova-compute[74638]:   <memory unit='KiB'>524288</memory>
Nov 08 20:10:14 user nova-compute[74638]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 20:10:14 user nova-compute[74638]:   <vcpu placement='static'>1</vcpu>
Nov 08 20:10:14 user nova-compute[74638]:   <resource>
Nov 08 20:10:14 user nova-compute[74638]:     <partition>/machine</partition>
Nov 08 20:10:14 user nova-compute[74638]:   </resource>
Nov 08 20:10:14 user nova-compute[74638]:   <sysinfo type='smbios'>
Nov 08 20:10:14 user nova-compute[74638]:     <system>
Nov 08 20:10:14 user nova-compute[74638]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 20:10:14 user nova-compute[74638]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 20:10:14 user nova-compute[74638]:       <entry name='version'>0.0.0</entry>
Nov 08 20:10:14 user nova-compute[74638]:       <entry name='serial'>b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:10:14 user nova-compute[74638]:       <entry name='uuid'>b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:10:14 user nova-compute[74638]:       <entry name='family'>Virtual Machine</entry>
Nov 08 20:10:14 user nova-compute[74638]:     </system>
Nov 08 20:10:14 user nova-compute[74638]:   </sysinfo>
Nov 08 20:10:14 user nova-compute[74638]:   <os>
Nov 08 20:10:14 user nova-compute[74638]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 20:10:14 user nova-compute[74638]:     <boot dev='hd'/>
Nov 08 20:10:14 user nova-compute[74638]:     <smbios mode='sysinfo'/>
Nov 08 20:10:14 user nova-compute[74638]:   </os>
Nov 08 20:10:14 user nova-compute[74638]:   <features>
Nov 08 20:10:14 user nova-compute[74638]:     <acpi/>
Nov 08 20:10:14 user nova-compute[74638]:     <apic/>
Nov 08 20:10:14 user nova-compute[74638]:     <vmcoreinfo state='on'/>
Nov 08 20:10:14 user nova-compute[74638]:   </features>
Nov 08 20:10:14 user nova-compute[74638]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 20:10:14 user nova-compute[74638]:     <model fallback='forbid'>Nehalem</model>
Nov 08 20:10:14 user nova-compute[74638]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 20:10:14 user nova-compute[74638]:     <feature policy='require' name='vme'/>
Nov 08 20:10:14 user nova-compute[74638]:     <feature policy='require' name='x2apic'/>
Nov 08 20:10:14 user nova-compute[74638]:     <feature policy='require' name='hypervisor'/>
Nov 08 20:10:14 user nova-compute[74638]:   </cpu>
Nov 08 20:10:14 user nova-compute[74638]:   <clock offset='utc'>
Nov 08 20:10:14 user nova-compute[74638]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 20:10:14 user nova-compute[74638]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 20:10:14 user nova-compute[74638]:     <timer name='hpet' present='no'/>
Nov 08 20:10:14 user nova-compute[74638]:   </clock>
Nov 08 20:10:14 user nova-compute[74638]:   <on_poweroff>destroy</on_poweroff>
Nov 08 20:10:14 user nova-compute[74638]:   <on_reboot>restart</on_reboot>
Nov 08 20:10:14 user nova-compute[74638]:   <on_crash>destroy</on_crash>
Nov 08 20:10:14 user nova-compute[74638]:   <devices>
Nov 08 20:10:14 user nova-compute[74638]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 20:10:14 user nova-compute[74638]:     <disk type='file' device='disk'>
Nov 08 20:10:14 user nova-compute[74638]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 20:10:14 user nova-compute[74638]:       <source file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk' index='2'/>
Nov 08 20:10:14 user nova-compute[74638]:       <backingStore type='file' index='3'>
Nov 08 20:10:14 user nova-compute[74638]:         <format type='raw'/>
Nov 08 20:10:14 user nova-compute[74638]:         <source file='/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835'/>
Nov 08 20:10:14 user nova-compute[74638]:         <backingStore/>
Nov 08 20:10:14 user nova-compute[74638]:       </backingStore>
Nov 08 20:10:14 user nova-compute[74638]:       <target dev='vda' bus='virtio'/>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='virtio-disk0'/>
Nov 08 20:10:14 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </disk>
Nov 08 20:10:14 user nova-compute[74638]:     <disk type='file' device='cdrom'>
Nov 08 20:10:14 user nova-compute[74638]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 20:10:14 user nova-compute[74638]:       <source file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.config' index='1'/>
Nov 08 20:10:14 user nova-compute[74638]:       <backingStore/>
Nov 08 20:10:14 user nova-compute[74638]:       <target dev='hda' bus='ide'/>
Nov 08 20:10:14 user nova-compute[74638]:       <readonly/>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='ide0-0-0'/>
Nov 08 20:10:14 user nova-compute[74638]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </disk>
Nov 08 20:10:14 user nova-compute[74638]:     <controller type='usb' index='0' model='none'>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='usb'/>
Nov 08 20:10:14 user nova-compute[74638]:     </controller>
Nov 08 20:10:14 user nova-compute[74638]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='pci.0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </controller>
Nov 08 20:10:14 user nova-compute[74638]:     <controller type='ide' index='0'>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='ide'/>
Nov 08 20:10:14 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 20:10:14 user nova-compute[74638]:     </controller>
Nov 08 20:10:14 user nova-compute[74638]:     <interface type='ethernet'>
Nov 08 20:10:14 user nova-compute[74638]:       <mac address='fa:16:3e:a8:67:68'/>
Nov 08 20:10:14 user nova-compute[74638]:       <target dev='tap18e2eb15-f6'/>
Nov 08 20:10:14 user nova-compute[74638]:       <model type='virtio'/>
Nov 08 20:10:14 user nova-compute[74638]:       <mtu size='1442'/>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='net0'/>
Nov 08 20:10:14 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </interface>
Nov 08 20:10:14 user nova-compute[74638]:     <interface type='ethernet'>
Nov 08 20:10:14 user nova-compute[74638]:       <mac address='fa:16:3e:46:05:1d'/>
Nov 08 20:10:14 user nova-compute[74638]:       <target dev='tapde0772c3-b1'/>
Nov 08 20:10:14 user nova-compute[74638]:       <model type='virtio'/>
Nov 08 20:10:14 user nova-compute[74638]:       <mtu size='1442'/>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='net1'/>
Nov 08 20:10:14 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </interface>
Nov 08 20:10:14 user nova-compute[74638]:     <serial type='pty'>
Nov 08 20:10:14 user nova-compute[74638]:       <source path='/dev/pts/6'/>
Nov 08 20:10:14 user nova-compute[74638]:       <log file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log' append='off'/>
Nov 08 20:10:14 user nova-compute[74638]:       <target type='isa-serial' port='0'>
Nov 08 20:10:14 user nova-compute[74638]:         <model name='isa-serial'/>
Nov 08 20:10:14 user nova-compute[74638]:       </target>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='serial0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </serial>
Nov 08 20:10:14 user nova-compute[74638]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 20:10:14 user nova-compute[74638]:       <source path='/dev/pts/6'/>
Nov 08 20:10:14 user nova-compute[74638]:       <log file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log' append='off'/>
Nov 08 20:10:14 user nova-compute[74638]:       <target type='serial' port='0'/>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='serial0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </console>
Nov 08 20:10:14 user nova-compute[74638]:     <input type='mouse' bus='ps2'>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='input0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </input>
Nov 08 20:10:14 user nova-compute[74638]:     <input type='keyboard' bus='ps2'>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='input1'/>
Nov 08 20:10:14 user nova-compute[74638]:     </input>
Nov 08 20:10:14 user nova-compute[74638]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 20:10:14 user nova-compute[74638]:       <listen type='address' address='0.0.0.0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </graphics>
Nov 08 20:10:14 user nova-compute[74638]:     <audio id='1' type='none'/>
Nov 08 20:10:14 user nova-compute[74638]:     <video>
Nov 08 20:10:14 user nova-compute[74638]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='video0'/>
Nov 08 20:10:14 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </video>
Nov 08 20:10:14 user nova-compute[74638]:     <memballoon model='virtio'>
Nov 08 20:10:14 user nova-compute[74638]:       <stats period='10'/>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='balloon0'/>
Nov 08 20:10:14 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </memballoon>
Nov 08 20:10:14 user nova-compute[74638]:     <rng model='virtio'>
Nov 08 20:10:14 user nova-compute[74638]:       <backend model='random'>/dev/urandom</backend>
Nov 08 20:10:14 user nova-compute[74638]:       <alias name='rng0'/>
Nov 08 20:10:14 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 20:10:14 user nova-compute[74638]:     </rng>
Nov 08 20:10:14 user nova-compute[74638]:   </devices>
Nov 08 20:10:14 user nova-compute[74638]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 20:10:14 user nova-compute[74638]:     <label>libvirt-b2192b24-bca8-467c-b408-f6f645d5557f</label>
Nov 08 20:10:14 user nova-compute[74638]:     <imagelabel>libvirt-b2192b24-bca8-467c-b408-f6f645d5557f</imagelabel>
Nov 08 20:10:14 user nova-compute[74638]:   </seclabel>
Nov 08 20:10:14 user nova-compute[74638]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 20:10:14 user nova-compute[74638]:     <label>+64055:+108</label>
Nov 08 20:10:14 user nova-compute[74638]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 20:10:14 user nova-compute[74638]:   </seclabel>
Nov 08 20:10:14 user nova-compute[74638]: </domain>
Nov 08 20:10:14 user nova-compute[74638]:  {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 20:10:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Successfully detached device tapde0772c3-b1 from instance b2192b24-bca8-467c-b408-f6f645d5557f from the persistent domain config.
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] (1/8): Attempting to detach device tapde0772c3-b1 with device alias net1 from instance b2192b24-bca8-467c-b408-f6f645d5557f from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] detach device xml: <interface type="ethernet">
Nov 08 20:10:14 user nova-compute[74638]:   <mac address="fa:16:3e:46:05:1d"/>
Nov 08 20:10:14 user nova-compute[74638]:   <model type="virtio"/>
Nov 08 20:10:14 user nova-compute[74638]:   <mtu size="1442"/>
Nov 08 20:10:14 user nova-compute[74638]:   <target dev="tapde0772c3-b1"/>
Nov 08 20:10:14 user nova-compute[74638]: </interface>
Nov 08 20:10:14 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMGdizJn" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb57fef1-904b-4bb3-833f-f3214fe1199a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BMGdizJn'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44e4760-8c98-44ee-9fe8-5c8b9c25de9c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[08235681-2d2d-46fc-8a1b-5f1fd4123498]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a9cd0a-8aba-4b5b-9a8f-dd8143b92be9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf, portal: 172.16.0.220,3260]
Nov 08 20:10:14 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6053b-cf6d-4349-bdcf-920edff55efc]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed4d9fc-a651-4629-8773-152f5b58146d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:14 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] HCTL ('35', '-', '-', 0) found on session 9 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d04eb4-2fe4-497a-b80d-8c5c860556ce]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMGdizJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Start waiting for the detach event from libvirt for device tapde0772c3-b1 with device alias net1 for instance b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-04871241-5d76-4a03-9814-84fda4e99cb0 req-31d50536-0134-48ff-88a9-0eb48dc1d6ba service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-unplugged-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-04871241-5d76-4a03-9814-84fda4e99cb0 req-31d50536-0134-48ff-88a9-0eb48dc1d6ba service nova] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-04871241-5d76-4a03-9814-84fda4e99cb0 req-31d50536-0134-48ff-88a9-0eb48dc1d6ba service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-04871241-5d76-4a03-9814-84fda4e99cb0 req-31d50536-0134-48ff-88a9-0eb48dc1d6ba service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-04871241-5d76-4a03-9814-84fda4e99cb0 req-31d50536-0134-48ff-88a9-0eb48dc1d6ba service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] No waiting events found dispatching network-vif-unplugged-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:15 user nova-compute[74638]: WARNING nova.compute.manager [req-04871241-5d76-4a03-9814-84fda4e99cb0 req-31d50536-0134-48ff-88a9-0eb48dc1d6ba service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received unexpected event network-vif-unplugged-de0772c3-b1d6-4307-b55c-494418b9437c for instance with vm_state active and task_state None.
Nov 08 20:10:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '23032663434346533', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032663434346533', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxkJfDHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:15 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:15 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:15 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cd38f5-375c-4eb1-8dbe-5aadde84885e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:10:15 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[805ec395-9852-4331-8178-42c291837350]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9] added
Nov 08 20:10:15 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 235929600 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2eb566-c42d-4b4e-a6c8-f77f033e0129]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[988cb486-b654-417e-a8ea-12a670fe71b2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxkJfDHT {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mxkJfDHT" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c53f90d-f596-4d13-bef3-20d42fb5c433]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mxkJfDHT'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b91febb-6ef3-403a-9145-cdfe2b79a460]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d853856-2d82-4ed0-a8d9-e4f0382ea798]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:15 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:15 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:15 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:15 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:15 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:15 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:15 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:15 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[34199161-851c-41cd-b22d-dce087c22fab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9, portal: 172.16.0.220,3260]
Nov 08 20:10:15 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:15 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcc2818-18f9-4321-bdb1-ba5982fbf3a2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6873dd4a-c68f-4002-a980-161c098dc2f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:16 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:16 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:16 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:16 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:16 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:16 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:16 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:16 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:16 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:16 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4d2408-1fbf-4fbc-9e59-08e369232aad]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG nova.objects.instance [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lazy-loading 'flavor' on Instance uuid e8daf0a9-b049-4dad-8128-cb34cf241da3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7f0e80bb-32f2-492c-8c18-9906886a2f4f tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.755s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 364904448 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG nova.objects.instance [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lazy-loading 'flavor' on Instance uuid 03d6123e-19ab-4fcf-9df5-770ca5e30422 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e846ee70-5f42-4079-af1a-3467ba43b3e7 tempest-VolumesAssistedSnapshotsTest-575418414 tempest-VolumesAssistedSnapshotsTest-575418414-project-admin] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.457s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lazy-loading 'flavor' on Instance uuid 204d636f-c342-45df-a083-7aa388a62c54 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.volume.cinder [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Update attachment failed for attachment 70d532b4-85d8-4e5f-bb37-69152334ff13. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bba33882-05bd-472e-b56c-ca2e5353e8f3) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bba33882-05bd-472e-b56c-ca2e5353e8f3)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Failed to attach 6f9209b9-6383-4937-8742-e135adbc6a76 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bba33882-05bd-472e-b56c-ca2e5353e8f3)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Traceback (most recent call last):
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     self._do_attach(context, instance, volume, volume_api,
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     self._volume_attach(context, volume, connector, instance,
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     connection_info = volume_api.attachment_update(
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     res = method(self, ctx, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     with excutils.save_and_reraise_exception():
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     self.force_reraise()
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     raise self.value
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     return method.func(obj, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     resp = self._update('/attachments/%s' % id, body)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     return self.request(url, method, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828]     raise exceptions.from_response(resp, body)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bba33882-05bd-472e-b56c-ca2e5353e8f3)
Nov 08 20:10:16 user nova-compute[74638]: ERROR nova.compute.manager [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] 
Nov 08 20:10:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 487587840 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.131s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:16 user nova-compute[74638]: INFO nova.compute.manager [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Terminating instance
Nov 08 20:10:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:16 user nova-compute[74638]: INFO nova.compute.manager [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Attaching volume 183f4be4-ff4a-4363-a808-fc87944f771d to /dev/vdb
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server [None req-9a3ee978-27a4-4b73-a11b-98d8ecf11e5a tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bba33882-05bd-472e-b56c-ca2e5353e8f3)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bba33882-05bd-472e-b56c-ca2e5353e8f3)
Nov 08 20:10:16 user nova-compute[74638]: ERROR oslo_messaging.rpc.server 
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.utils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-ee544020-7982-4282-a642-17ff03553ebb req-61736b0f-8c28-42b5-995f-af454394c134 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ee544020-7982-4282-a642-17ff03553ebb req-61736b0f-8c28-42b5-995f-af454394c134 service nova] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ee544020-7982-4282-a642-17ff03553ebb req-61736b0f-8c28-42b5-995f-af454394c134 service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ee544020-7982-4282-a642-17ff03553ebb req-61736b0f-8c28-42b5-995f-af454394c134 service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-ee544020-7982-4282-a642-17ff03553ebb req-61736b0f-8c28-42b5-995f-af454394c134 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] No waiting events found dispatching network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:17 user nova-compute[74638]: WARNING nova.compute.manager [req-ee544020-7982-4282-a642-17ff03553ebb req-61736b0f-8c28-42b5-995f-af454394c134 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received unexpected event network-vif-plugged-de0772c3-b1d6-4307-b55c-494418b9437c for instance with vm_state active and task_state None.
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[36370a96-3cfc-4a46-816d-d427d7f1e512]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxkJfDHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26531353434393361', 'path': '/dev/sdf'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531353434393361', 'path': '/dev/sdf'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1ddd0d-4615-4629-aa5c-b15b9f3ef101]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ea855e-92f7-4771-8df4-63b6bbca8756]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[878e5959-4133-4fb9-9a20-218cb6ec19fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrpAdvqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:17 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:17 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:17 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[103df5a1-1c69-463c-b256-84eab029953b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:10:17 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:10:17 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd9dcc4-d64c-4065-bbd2-7d3855d8c8f0]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.utils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] <== get_connector_properties: return (253ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Updating existing volume attachment record: 3038da69-7265-4ce5-93b2-e9ca42bc99fa {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[44030b9d-9470-4090-bfa1-eb58b5c999af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-7d051d5b-01f0-46ca-ae82-307e1c60345a req-36ae902c-01b4-4b75-b68d-19314223f559 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received event network-vif-unplugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7d051d5b-01f0-46ca-ae82-307e1c60345a req-36ae902c-01b4-4b75-b68d-19314223f559 service nova] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7d051d5b-01f0-46ca-ae82-307e1c60345a req-36ae902c-01b4-4b75-b68d-19314223f559 service nova] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7d051d5b-01f0-46ca-ae82-307e1c60345a req-36ae902c-01b4-4b75-b68d-19314223f559 service nova] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-7d051d5b-01f0-46ca-ae82-307e1c60345a req-36ae902c-01b4-4b75-b68d-19314223f559 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] No waiting events found dispatching network-vif-unplugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-7d051d5b-01f0-46ca-ae82-307e1c60345a req-36ae902c-01b4-4b75-b68d-19314223f559 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received event network-vif-unplugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1] added
Nov 08 20:10:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[826d2a9f-3ab2-4f72-b14d-ebe5a23a74e7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[83df506b-5d23-4d49-8617-de9c97597009]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yrpAdvqV {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yrpAdvqV" returned: 0 in 0.035s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0277c5-de4a-4e1c-b971-25dd9b7be4d7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yrpAdvqV'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8960cd-8ef2-4378-8d13-502f49b46c11]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc96d7-ed31-4db7-b88f-607a75c91198]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a5988f-394d-4351-8942-fef73a1ca99e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1, portal: 172.16.0.220,3260]
Nov 08 20:10:17 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7660e8-1266-481e-be5d-8c419178cdcb]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b96e1b3-e197-42f8-b0b6-568cfeecda12]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:17 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.517s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.032s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae468c6c-7486-475e-b5f5-966bbe9f7bf8]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:17 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Instance destroyed successfully.
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.objects.instance [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lazy-loading 'resources' on Instance uuid e8daf0a9-b049-4dad-8128-cb34cf241da3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-772174861',display_name='tempest-AttachSCSIVolumeTestJSON-server-772174861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-772174861',id=6,image_ref='62705185-baaf-4bc0-be1f-f41ca9556849',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7MilvXEUJ548Dmtqd44r3GHIsZp/g7rAszmwMNkiWeCHGHUfwDDCiXwUZa8valesB2bN49hhgQArJF3ck5vlZSokI3cU9amOY9PkQ8fdT9odXjsh4Ha7QA66qCC55/aQ==',key_name='tempest-keypair-372527692',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc41c3a21fb34b82a66eaa4c3ebf293b',ramdisk_id='',reservation_id='r-c0bhnoev',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='62705185-baaf-4bc0-be1f-f41ca9556849',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-922557478',owner_user_name='tempest-AttachSCSIVolumeTestJSON-922557478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41550eb95068416b92ec47d447f66ff6',uuid=e8daf0a9-b049-4dad-8128-cb34cf241da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Converting VIF {"id": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "address": "fa:16:3e:54:dd:ab", "network": {"id": "e75879e5-faba-4f9f-a527-4e0b4010a580", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-87973746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc41c3a21fb34b82a66eaa4c3ebf293b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap786b38d9-2e", "ovs_interfaceid": "786b38d9-2eb5-4dff-9c4a-0776f304a821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:dd:ab,bridge_name='br-int',has_traffic_filtering=True,id=786b38d9-2eb5-4dff-9c4a-0776f304a821,network=Network(e75879e5-faba-4f9f-a527-4e0b4010a580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap786b38d9-2e') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG os_vif [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:dd:ab,bridge_name='br-int',has_traffic_filtering=True,id=786b38d9-2eb5-4dff-9c4a-0776f304a821,network=Network(e75879e5-faba-4f9f-a527-4e0b4010a580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap786b38d9-2e') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap786b38d9-2e, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 786432000 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de5d7d4b-65cc-41a6-95ad-e75c59ebaf5f) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:17 user nova-compute[74638]: INFO os_vif [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:dd:ab,bridge_name='br-int',has_traffic_filtering=True,id=786b38d9-2eb5-4dff-9c4a-0776f304a821,network=Network(e75879e5-faba-4f9f-a527-4e0b4010a580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap786b38d9-2e')
Nov 08 20:10:17 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Deleting instance files /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3_del
Nov 08 20:10:17 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Deletion of /opt/stack/data/nova/instances/e8daf0a9-b049-4dad-8128-cb34cf241da3_del complete
Nov 08 20:10:18 user nova-compute[74638]: INFO nova.compute.manager [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 08 20:10:18 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 970981376 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrpAdvqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.571s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== connect_volume: return (1576ms) {'type': 'block', 'scsi_wwn': '23436616164653338', 'path': '/dev/sdg'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436616164653338', 'path': '/dev/sdg'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d0:13,bridge_name='br-int',has_traffic_filtering=True,id=39f6ae3f-3753-4366-9981-c55d3e1c5742,network=Network(ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ae3f-37') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:47:08,bridge_name='br-int',has_traffic_filtering=True,id=e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a3d17e-e8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:85:2a,bridge_name='br-int',has_traffic_filtering=True,id=d2fdd908-4718-40b1-9b99-5ebf4604b9df,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2fdd908-47') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:b3,bridge_name='br-int',has_traffic_filtering=True,id=14326ab0-0b69-421f-a8f2-415d96da78ae,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14326ab0-0b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:e6:1b,bridge_name='br-int',has_traffic_filtering=True,id=31ed79ac-1c5f-4569-977b-afa85fec9d49,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ed79ac-1c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:68,bridge_name='br-int',has_traffic_filtering=True,id=6a6b4dcd-90cb-4c1c-b2e4-f128d950e805,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b4dcd-90') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:d8,bridge_name='br-int',has_traffic_filtering=True,id=dda4bb7c-991c-4ed3-893f-1db9ef50c161,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda4bb7c-99') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.objects.instance [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lazy-loading 'pci_devices' on Instance uuid a690cfa9-2a34-43a9-843b-e7548703a5e3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:10:18 user nova-compute[74638]:   <uuid>a690cfa9-2a34-43a9-843b-e7548703a5e3</uuid>
Nov 08 20:10:18 user nova-compute[74638]:   <name>instance-0000000a</name>
Nov 08 20:10:18 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:10:18 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:10:18 user nova-compute[74638]:   <metadata>
Nov 08 20:10:18 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:10:18 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:10:18 user nova-compute[74638]:       <nova:name>tempest-device-tagging-server-2074346570</nova:name>
Nov 08 20:10:18 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:10:14</nova:creationTime>
Nov 08 20:10:18 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:10:18 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:10:18 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:10:18 user nova-compute[74638]:       <nova:owner>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:user uuid="1c7f6cb5c4b445bab1b501bc8aff5523">tempest-TaggedBootDevicesTest-1750493064-project-member</nova:user>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:project uuid="33f19fa23d934a7ea5ffb026c605c8d9">tempest-TaggedBootDevicesTest-1750493064</nova:project>
Nov 08 20:10:18 user nova-compute[74638]:       </nova:owner>
Nov 08 20:10:18 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:10:18 user nova-compute[74638]:       <nova:ports>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:port uuid="39f6ae3f-3753-4366-9981-c55d3e1c5742">
Nov 08 20:10:18 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 20:10:18 user nova-compute[74638]:         </nova:port>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:port uuid="e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c">
Nov 08 20:10:18 user nova-compute[74638]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Nov 08 20:10:18 user nova-compute[74638]:         </nova:port>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:port uuid="d2fdd908-4718-40b1-9b99-5ebf4604b9df">
Nov 08 20:10:18 user nova-compute[74638]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 08 20:10:18 user nova-compute[74638]:         </nova:port>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:port uuid="14326ab0-0b69-421f-a8f2-415d96da78ae">
Nov 08 20:10:18 user nova-compute[74638]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
Nov 08 20:10:18 user nova-compute[74638]:         </nova:port>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:port uuid="31ed79ac-1c5f-4569-977b-afa85fec9d49">
Nov 08 20:10:18 user nova-compute[74638]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Nov 08 20:10:18 user nova-compute[74638]:         </nova:port>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:port uuid="6a6b4dcd-90cb-4c1c-b2e4-f128d950e805">
Nov 08 20:10:18 user nova-compute[74638]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 20:10:18 user nova-compute[74638]:         </nova:port>
Nov 08 20:10:18 user nova-compute[74638]:         <nova:port uuid="dda4bb7c-991c-4ed3-893f-1db9ef50c161">
Nov 08 20:10:18 user nova-compute[74638]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 20:10:18 user nova-compute[74638]:         </nova:port>
Nov 08 20:10:18 user nova-compute[74638]:       </nova:ports>
Nov 08 20:10:18 user nova-compute[74638]:     </nova:instance>
Nov 08 20:10:18 user nova-compute[74638]:   </metadata>
Nov 08 20:10:18 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:10:18 user nova-compute[74638]:     <system>
Nov 08 20:10:18 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:10:18 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:10:18 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:10:18 user nova-compute[74638]:       <entry name="serial">a690cfa9-2a34-43a9-843b-e7548703a5e3</entry>
Nov 08 20:10:18 user nova-compute[74638]:       <entry name="uuid">a690cfa9-2a34-43a9-843b-e7548703a5e3</entry>
Nov 08 20:10:18 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:10:18 user nova-compute[74638]:     </system>
Nov 08 20:10:18 user nova-compute[74638]:   </sysinfo>
Nov 08 20:10:18 user nova-compute[74638]:   <os>
Nov 08 20:10:18 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:10:18 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:10:18 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:10:18 user nova-compute[74638]:   </os>
Nov 08 20:10:18 user nova-compute[74638]:   <features>
Nov 08 20:10:18 user nova-compute[74638]:     <acpi/>
Nov 08 20:10:18 user nova-compute[74638]:     <apic/>
Nov 08 20:10:18 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:10:18 user nova-compute[74638]:   </features>
Nov 08 20:10:18 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:10:18 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:10:18 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:10:18 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:10:18 user nova-compute[74638]:   </clock>
Nov 08 20:10:18 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:10:18 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:10:18 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:10:18 user nova-compute[74638]:   </cpu>
Nov 08 20:10:18 user nova-compute[74638]:   <devices>
Nov 08 20:10:18 user nova-compute[74638]:     <disk type="file" device="cdrom">
Nov 08 20:10:18 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 20:10:18 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/a690cfa9-2a34-43a9-843b-e7548703a5e3/disk.config"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="hda" bus="ide"/>
Nov 08 20:10:18 user nova-compute[74638]:     </disk>
Nov 08 20:10:18 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:10:18 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:10:18 user nova-compute[74638]:       <source dev="/dev/sdd"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <serial>a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf</serial>
Nov 08 20:10:18 user nova-compute[74638]:     </disk>
Nov 08 20:10:18 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:10:18 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:10:18 user nova-compute[74638]:       <source dev="/dev/sdf"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <serial>7fef1b92-755c-45c5-abb1-deae92811bb9</serial>
Nov 08 20:10:18 user nova-compute[74638]:     </disk>
Nov 08 20:10:18 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:10:18 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:10:18 user nova-compute[74638]:       <source dev="/dev/sdg"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="vdc" bus="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <serial>3ca0a9e4-603e-406f-876a-dadeca621ab1</serial>
Nov 08 20:10:18 user nova-compute[74638]:     </disk>
Nov 08 20:10:18 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:10:18 user nova-compute[74638]:       <mac address="fa:16:3e:8a:d0:13"/>
Nov 08 20:10:18 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="tap39f6ae3f-37"/>
Nov 08 20:10:18 user nova-compute[74638]:     </interface>
Nov 08 20:10:18 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:10:18 user nova-compute[74638]:       <mac address="fa:16:3e:9a:47:08"/>
Nov 08 20:10:18 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="tape1a3d17e-e8"/>
Nov 08 20:10:18 user nova-compute[74638]:     </interface>
Nov 08 20:10:18 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:10:18 user nova-compute[74638]:       <mac address="fa:16:3e:8e:85:2a"/>
Nov 08 20:10:18 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="tapd2fdd908-47"/>
Nov 08 20:10:18 user nova-compute[74638]:     </interface>
Nov 08 20:10:18 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:10:18 user nova-compute[74638]:       <mac address="fa:16:3e:e0:e5:b3"/>
Nov 08 20:10:18 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="tap14326ab0-0b"/>
Nov 08 20:10:18 user nova-compute[74638]:     </interface>
Nov 08 20:10:18 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:10:18 user nova-compute[74638]:       <mac address="fa:16:3e:79:e6:1b"/>
Nov 08 20:10:18 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="tap31ed79ac-1c"/>
Nov 08 20:10:18 user nova-compute[74638]:     </interface>
Nov 08 20:10:18 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:10:18 user nova-compute[74638]:       <mac address="fa:16:3e:20:fa:68"/>
Nov 08 20:10:18 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="tap6a6b4dcd-90"/>
Nov 08 20:10:18 user nova-compute[74638]:     </interface>
Nov 08 20:10:18 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:10:18 user nova-compute[74638]:       <mac address="fa:16:3e:92:98:d8"/>
Nov 08 20:10:18 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:10:18 user nova-compute[74638]:       <target dev="tapdda4bb7c-99"/>
Nov 08 20:10:18 user nova-compute[74638]:     </interface>
Nov 08 20:10:18 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:10:18 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/a690cfa9-2a34-43a9-843b-e7548703a5e3/console.log" append="off"/>
Nov 08 20:10:18 user nova-compute[74638]:     </serial>
Nov 08 20:10:18 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:10:18 user nova-compute[74638]:     <video>
Nov 08 20:10:18 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:10:18 user nova-compute[74638]:     </video>
Nov 08 20:10:18 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:10:18 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:10:18 user nova-compute[74638]:     </rng>
Nov 08 20:10:18 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:10:18 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:10:18 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:10:18 user nova-compute[74638]:     </memballoon>
Nov 08 20:10:18 user nova-compute[74638]:   </devices>
Nov 08 20:10:18 user nova-compute[74638]: </domain>
Nov 08 20:10:18 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d0:13,bridge_name='br-int',has_traffic_filtering=True,id=39f6ae3f-3753-4366-9981-c55d3e1c5742,network=Network(ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ae3f-37') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d0:13,bridge_name='br-int',has_traffic_filtering=True,id=39f6ae3f-3753-4366-9981-c55d3e1c5742,network=Network(ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ae3f-37') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb937da2-e8c2-52d6-8531-0f5c6704bb55', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39f6ae3f-37, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39f6ae3f-37, col_values=(('qos', UUID('7038a7b7-6f53-4a73-a2cd-8858a33e9188')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39f6ae3f-37, col_values=(('external_ids', {'iface-id': '39f6ae3f-3753-4366-9981-c55d3e1c5742', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:d0:13', 'vm-uuid': 'a690cfa9-2a34-43a9-843b-e7548703a5e3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: INFO os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d0:13,bridge_name='br-int',has_traffic_filtering=True,id=39f6ae3f-3753-4366-9981-c55d3e1c5742,network=Network(ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ae3f-37')
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:47:08,bridge_name='br-int',has_traffic_filtering=True,id=e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a3d17e-e8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:47:08,bridge_name='br-int',has_traffic_filtering=True,id=e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a3d17e-e8') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63e27a08-f583-5475-956c-1a332c79e598', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1a3d17e-e8, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1a3d17e-e8, col_values=(('qos', UUID('d8594892-1270-4f02-b96f-8f2e32d02943')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1a3d17e-e8, col_values=(('external_ids', {'iface-id': 'e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:47:08', 'vm-uuid': 'a690cfa9-2a34-43a9-843b-e7548703a5e3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:19 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f908e8-2550-4902-b6e6-7351eb2eddf9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:10:19 user nova-compute[74638]: No targets found.
Nov 08 20:10:19 user nova-compute[74638]: iSNS:
Nov 08 20:10:19 user nova-compute[74638]: No targets found.
Nov 08 20:10:19 user nova-compute[74638]: STATIC:
Nov 08 20:10:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05
Nov 08 20:10:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:10:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9
Nov 08 20:10:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf
Nov 08 20:10:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1
Nov 08 20:10:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:10:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:10:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:10:19 user nova-compute[74638]: FIRMWARE:
Nov 08 20:10:19 user nova-compute[74638]: No targets found.
Nov 08 20:10:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:10:19 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:10:19 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: INFO os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:47:08,bridge_name='br-int',has_traffic_filtering=True,id=e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a3d17e-e8')
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:85:2a,bridge_name='br-int',has_traffic_filtering=True,id=d2fdd908-4718-40b1-9b99-5ebf4604b9df,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2fdd908-47') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:85:2a,bridge_name='br-int',has_traffic_filtering=True,id=d2fdd908-4718-40b1-9b99-5ebf4604b9df,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2fdd908-47') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41ef1432-f73f-5558-9d45-2a7712439788', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d03cb-df09-442e-be01-2f35b353c3c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e3aaac-50ce-4e25-918c-0c7913695512]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:19 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c71e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2fdd908-47, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2fdd908-47, col_values=(('qos', UUID('722e5e16-9420-4049-9341-18ed765d1759')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2fdd908-47, col_values=(('external_ids', {'iface-id': 'd2fdd908-4718-40b1-9b99-5ebf4604b9df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:85:2a', 'vm-uuid': 'a690cfa9-2a34-43a9-843b-e7548703a5e3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a476d791-5e3b-4e02-afe9-524d3acc1a51]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[314d0a2c-3f31-4946-bd1d-abf9369f3cc4]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: INFO os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:85:2a,bridge_name='br-int',has_traffic_filtering=True,id=d2fdd908-4718-40b1-9b99-5ebf4604b9df,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2fdd908-47')
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:b3,bridge_name='br-int',has_traffic_filtering=True,id=14326ab0-0b69-421f-a8f2-415d96da78ae,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14326ab0-0b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:b3,bridge_name='br-int',has_traffic_filtering=True,id=14326ab0-0b69-421f-a8f2-415d96da78ae,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14326ab0-0b') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abe3bb4-dfca-4180-b76e-bc0d3c7c239a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41d61ffe-9b67-5c20-ae62-8bdf8ad4bb6f', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e15a7c-b7d9-41f4-a684-2c86699e3c20]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14326ab0-0b, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14326ab0-0b, col_values=(('qos', UUID('56b3f0a2-07c3-4f00-8158-8ee2e90b8f1f')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14326ab0-0b, col_values=(('external_ids', {'iface-id': '14326ab0-0b69-421f-a8f2-415d96da78ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e5:b3', 'vm-uuid': 'a690cfa9-2a34-43a9-843b-e7548703a5e3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d7641-981d-45fc-874a-edf6cb0e5421]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: INFO os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:b3,bridge_name='br-int',has_traffic_filtering=True,id=14326ab0-0b69-421f-a8f2-415d96da78ae,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14326ab0-0b')
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:e6:1b,bridge_name='br-int',has_traffic_filtering=True,id=31ed79ac-1c5f-4569-977b-afa85fec9d49,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ed79ac-1c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:e6:1b,bridge_name='br-int',has_traffic_filtering=True,id=31ed79ac-1c5f-4569-977b-afa85fec9d49,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ed79ac-1c') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80cdf4b9-a53c-5e19-963c-92a2797c3ba4', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d218eedb-0fc4-4af0-9eff-a4df4d3a0e32]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260]
Nov 08 20:10:19 user nova-compute[74638]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9948b34-8e06-457c-8dff-703442bd980d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] <== disconnect_volume: return (364ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-ead52029-7628-4b4a-a062-665043c90b8a req-be289af6-fb6c-4ee3-a1d6-fa03f34c76ad service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received event network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ead52029-7628-4b4a-a062-665043c90b8a req-be289af6-fb6c-4ee3-a1d6-fa03f34c76ad service nova] Acquiring lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ead52029-7628-4b4a-a062-665043c90b8a req-be289af6-fb6c-4ee3-a1d6-fa03f34c76ad service nova] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ead52029-7628-4b4a-a062-665043c90b8a req-be289af6-fb6c-4ee3-a1d6-fa03f34c76ad service nova] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-ead52029-7628-4b4a-a062-665043c90b8a req-be289af6-fb6c-4ee3-a1d6-fa03f34c76ad service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] No waiting events found dispatching network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:19 user nova-compute[74638]: WARNING nova.compute.manager [req-ead52029-7628-4b4a-a062-665043c90b8a req-be289af6-fb6c-4ee3-a1d6-fa03f34c76ad service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received unexpected event network-vif-plugged-786b38d9-2eb5-4dff-9c4a-0776f304a821 for instance with vm_state active and task_state deleting.
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31ed79ac-1c, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31ed79ac-1c, col_values=(('qos', UUID('ad7ad232-74b7-46d2-82d0-bda213b1e47d')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31ed79ac-1c, col_values=(('external_ids', {'iface-id': '31ed79ac-1c5f-4569-977b-afa85fec9d49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:e6:1b', 'vm-uuid': 'a690cfa9-2a34-43a9-843b-e7548703a5e3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Took 1.41 seconds to deallocate network for instance.
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-e6f835e9-ae4b-47f9-80a9-cec0a0045926 req-5c69bc03-d7ee-4d0e-b72e-8cb625b12d77 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Received event network-vif-deleted-786b38d9-2eb5-4dff-9c4a-0776f304a821 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:19 user nova-compute[74638]: INFO nova.compute.manager [req-e6f835e9-ae4b-47f9-80a9-cec0a0045926 req-5c69bc03-d7ee-4d0e-b72e-8cb625b12d77 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Neutron deleted interface 786b38d9-2eb5-4dff-9c4a-0776f304a821; detaching it from the instance and deleting it from the info cache
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.neutron [req-e6f835e9-ae4b-47f9-80a9-cec0a0045926 req-5c69bc03-d7ee-4d0e-b72e-8cb625b12d77 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-e6f835e9-ae4b-47f9-80a9-cec0a0045926 req-5c69bc03-d7ee-4d0e-b72e-8cb625b12d77 service nova] [instance: e8daf0a9-b049-4dad-8128-cb34cf241da3] Detach interface failed, port_id=786b38d9-2eb5-4dff-9c4a-0776f304a821, reason: Instance e8daf0a9-b049-4dad-8128-cb34cf241da3 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKhUgmHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '24b78656-ca13-42c8-b45c-e0c1526c1fee', 'attached_at': '', 'detached_at': '', 'volume_id': 'de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'serial'} {{(pid=74638) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] swap_volume: removing Cinder connection for volume 9f55b694-5668-468b-87db-dd20af9c0eee {{(pid=74638) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: INFO os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:e6:1b,bridge_name='br-int',has_traffic_filtering=True,id=31ed79ac-1c5f-4569-977b-afa85fec9d49,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ed79ac-1c')
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:68,bridge_name='br-int',has_traffic_filtering=True,id=6a6b4dcd-90cb-4c1c-b2e4-f128d950e805,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b4dcd-90') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:68,bridge_name='br-int',has_traffic_filtering=True,id=6a6b4dcd-90cb-4c1c-b2e4-f128d950e805,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b4dcd-90') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed2ec6e6-6852-5c6f-8f13-d483ec5b0d8c', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a6b4dcd-90, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a6b4dcd-90, col_values=(('qos', UUID('a5405acc-4bf3-475d-9612-e05e14384ada')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a6b4dcd-90, col_values=(('external_ids', {'iface-id': '6a6b4dcd-90cb-4c1c-b2e4-f128d950e805', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:fa:68', 'vm-uuid': 'a690cfa9-2a34-43a9-843b-e7548703a5e3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: INFO os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:68,bridge_name='br-int',has_traffic_filtering=True,id=6a6b4dcd-90cb-4c1c-b2e4-f128d950e805,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b4dcd-90')
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:d8,bridge_name='br-int',has_traffic_filtering=True,id=dda4bb7c-991c-4ed3-893f-1db9ef50c161,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda4bb7c-99') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:d8,bridge_name='br-int',has_traffic_filtering=True,id=dda4bb7c-991c-4ed3-893f-1db9ef50c161,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda4bb7c-99') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a392e9e1-fb8a-59fa-a980-760a7a4b3393', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdda4bb7c-99, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdda4bb7c-99, col_values=(('qos', UUID('113b946d-2b00-4f08-a4dc-71aa65c3be1f')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdda4bb7c-99, col_values=(('external_ids', {'iface-id': 'dda4bb7c-991c-4ed3-893f-1db9ef50c161', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:98:d8', 'vm-uuid': 'a690cfa9-2a34-43a9-843b-e7548703a5e3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:19 user nova-compute[74638]: INFO os_vif [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:d8,bridge_name='br-int',has_traffic_filtering=True,id=dda4bb7c-991c-4ed3-893f-1db9ef50c161,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda4bb7c-99')
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] No BDM found with device name hda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] No VIF found with MAC fa:16:3e:8a:d0:13, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:10:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] No VIF found with MAC fa:16:3e:79:e6:1b, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:10:19 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Using config drive
Nov 08 20:10:19 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Deleted allocations for instance e8daf0a9-b049-4dad-8128-cb34cf241da3
Nov 08 20:10:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cac75106-a202-4439-8905-21b05c5c5461 tempest-AttachSCSIVolumeTestJSON-922557478 tempest-AttachSCSIVolumeTestJSON-922557478-project-member] Lock "e8daf0a9-b049-4dad-8128-cb34cf241da3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.172s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Creating config drive at /opt/stack/data/nova/instances/a690cfa9-2a34-43a9-843b-e7548703a5e3/disk.config
Nov 08 20:10:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a690cfa9-2a34-43a9-843b-e7548703a5e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpau7sluuw {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a690cfa9-2a34-43a9-843b-e7548703a5e3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpau7sluuw" returned: 0 in 0.058s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] swap_volume: Updating volume 9f55b694-5668-468b-87db-dd20af9c0eee BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "CKhUgmHz", "auth_password": "hP0QZML37sSz4D", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "de3f1df7-03b4-46f8-b7fe-77402aa88e05"}, "status": "reserved", "instance": "24b78656-ca13-42c8-b45c-e0c1526c1fee", "attached_at": "", "detached_at": "", "volume_id": "de3f1df7-03b4-46f8-b7fe-77402aa88e05", "serial": "de3f1df7-03b4-46f8-b7fe-77402aa88e05"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'no_device': None, 'attachment_id': 'f6f5f390-82cc-4665-bf3d-842a6cecd800'} {{(pid=74638) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 20:10:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2e6365eb-479f-4cfc-8d28-949e0b5404ad tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 35.957s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG os_brick.utils [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc1b9db-5d31-433a-b59e-566a455f0f6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c367e-7e07-4991-9521-0a301302a1ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d4e35-abe2-47b8-b127-6f6a3c985147]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9eacfb-bc02-4768-b911-77d0ff207b16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:10:21 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0356433a-4027-464a-a5e6-53f0e7eeb60a]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG os_brick.utils [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:21 user nova-compute[74638]: INFO nova.compute.manager [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Swapping volume de3f1df7-03b4-46f8-b7fe-77402aa88e05 for 9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:10:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-019e7a87-cd43-44ef-ac5e-ebb4abcd5ff2 req-478580aa-e20e-49ec-b5c0-4946e6d96926 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-019e7a87-cd43-44ef-ac5e-ebb4abcd5ff2 req-478580aa-e20e-49ec-b5c0-4946e6d96926 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-019e7a87-cd43-44ef-ac5e-ebb4abcd5ff2 req-478580aa-e20e-49ec-b5c0-4946e6d96926 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-019e7a87-cd43-44ef-ac5e-ebb4abcd5ff2 req-478580aa-e20e-49ec-b5c0-4946e6d96926 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-019e7a87-cd43-44ef-ac5e-ebb4abcd5ff2 req-478580aa-e20e-49ec-b5c0-4946e6d96926 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:21 user nova-compute[74638]: WARNING nova.compute.manager [req-019e7a87-cd43-44ef-ac5e-ebb4abcd5ff2 req-478580aa-e20e-49ec-b5c0-4946e6d96926 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 for instance with vm_state building and task_state spawning.
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-2f9b93b2-765f-4e23-8519-f6884e700b67 req-ac74b2a3-b5f5-43e6-b6e9-3fb36d7c3d21 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2f9b93b2-765f-4e23-8519-f6884e700b67 req-ac74b2a3-b5f5-43e6-b6e9-3fb36d7c3d21 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2f9b93b2-765f-4e23-8519-f6884e700b67 req-ac74b2a3-b5f5-43e6-b6e9-3fb36d7c3d21 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2f9b93b2-765f-4e23-8519-f6884e700b67 req-ac74b2a3-b5f5-43e6-b6e9-3fb36d7c3d21 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-2f9b93b2-765f-4e23-8519-f6884e700b67 req-ac74b2a3-b5f5-43e6-b6e9-3fb36d7c3d21 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:22 user nova-compute[74638]: WARNING nova.compute.manager [req-2f9b93b2-765f-4e23-8519-f6884e700b67 req-ac74b2a3-b5f5-43e6-b6e9-3fb36d7c3d21 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c for instance with vm_state building and task_state spawning.
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-cb4968c9-4b40-402e-b8bc-8f440ae0086e req-3a835755-8c2d-488e-8fbc-4a5f90266540 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:24 user nova-compute[74638]: WARNING nova.compute.manager [req-3649746c-7708-4d53-aed7-6abfb12476a8 req-83280efe-b4d2-413a-b973-466469087066 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 for instance with vm_state building and task_state spawning.
Nov 08 20:10:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:26 user nova-compute[74638]: WARNING nova.compute.manager [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 for instance with vm_state building and task_state spawning.
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:26 user nova-compute[74638]: WARNING nova.compute.manager [req-6450c64f-ff21-47b1-a52a-362ffa065583 req-b152eec6-4042-44d7-8ac1-d35de71d72ba service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 for instance with vm_state building and task_state spawning.
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:10:26 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance spawned successfully.
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:10:26 user nova-compute[74638]: INFO nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Took 12.35 seconds to spawn the instance on the hypervisor.
Nov 08 20:10:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:10:26 user nova-compute[74638]: INFO nova.compute.manager [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Took 156.31 seconds to build instance.
Nov 08 20:10:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e3c61dd6-5d8b-42f2-8ff7-df134c421c8f tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 156.466s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:34 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Waiting for libvirt event about the detach of device tapde0772c3-b1 with device alias net1 from instance b2192b24-bca8-467c-b408-f6f645d5557f is timed out.
Nov 08 20:10:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface> {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 20:10:34 user nova-compute[74638]:   <name>instance-00000007</name>
Nov 08 20:10:34 user nova-compute[74638]:   <uuid>b2192b24-bca8-467c-b408-f6f645d5557f</uuid>
Nov 08 20:10:34 user nova-compute[74638]:   <metadata>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:10:34 user nova-compute[74638]:   <nova:package version="0.0.0"/>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:name>tempest-device-tagging-server-1887474706</nova:name>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:creationTime>2023-11-08 20:08:24</nova:creationTime>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:flavor name="m1.tiny">
Nov 08 20:10:34 user nova-compute[74638]:     <nova:memory>512</nova:memory>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:disk>1</nova:disk>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:swap>0</nova:swap>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:vcpus>1</nova:vcpus>
Nov 08 20:10:34 user nova-compute[74638]:   </nova:flavor>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:owner>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:user uuid="be705289f5974554ab1d6bc4e66735b5">tempest-TaggedAttachmentsTest-929214679-project-member</nova:user>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:project uuid="f83f180c62c64dcb83c30c7e3e8a5c4e">tempest-TaggedAttachmentsTest-929214679</nova:project>
Nov 08 20:10:34 user nova-compute[74638]:   </nova:owner>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:ports>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:port uuid="18e2eb15-f699-42ac-ac84-e6d446f1f59c">
Nov 08 20:10:34 user nova-compute[74638]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:10:34 user nova-compute[74638]:     </nova:port>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:port uuid="de0772c3-b1d6-4307-b55c-494418b9437c">
Nov 08 20:10:34 user nova-compute[74638]:       <nova:ip type="fixed" address="10.10.10.71" ipVersion="4"/>
Nov 08 20:10:34 user nova-compute[74638]:     </nova:port>
Nov 08 20:10:34 user nova-compute[74638]:   </nova:ports>
Nov 08 20:10:34 user nova-compute[74638]: </nova:instance>
Nov 08 20:10:34 user nova-compute[74638]:   </metadata>
Nov 08 20:10:34 user nova-compute[74638]:   <memory unit='KiB'>524288</memory>
Nov 08 20:10:34 user nova-compute[74638]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 20:10:34 user nova-compute[74638]:   <vcpu placement='static'>1</vcpu>
Nov 08 20:10:34 user nova-compute[74638]:   <resource>
Nov 08 20:10:34 user nova-compute[74638]:     <partition>/machine</partition>
Nov 08 20:10:34 user nova-compute[74638]:   </resource>
Nov 08 20:10:34 user nova-compute[74638]:   <sysinfo type='smbios'>
Nov 08 20:10:34 user nova-compute[74638]:     <system>
Nov 08 20:10:34 user nova-compute[74638]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 20:10:34 user nova-compute[74638]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 20:10:34 user nova-compute[74638]:       <entry name='version'>0.0.0</entry>
Nov 08 20:10:34 user nova-compute[74638]:       <entry name='serial'>b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:10:34 user nova-compute[74638]:       <entry name='uuid'>b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:10:34 user nova-compute[74638]:       <entry name='family'>Virtual Machine</entry>
Nov 08 20:10:34 user nova-compute[74638]:     </system>
Nov 08 20:10:34 user nova-compute[74638]:   </sysinfo>
Nov 08 20:10:34 user nova-compute[74638]:   <os>
Nov 08 20:10:34 user nova-compute[74638]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 20:10:34 user nova-compute[74638]:     <boot dev='hd'/>
Nov 08 20:10:34 user nova-compute[74638]:     <smbios mode='sysinfo'/>
Nov 08 20:10:34 user nova-compute[74638]:   </os>
Nov 08 20:10:34 user nova-compute[74638]:   <features>
Nov 08 20:10:34 user nova-compute[74638]:     <acpi/>
Nov 08 20:10:34 user nova-compute[74638]:     <apic/>
Nov 08 20:10:34 user nova-compute[74638]:     <vmcoreinfo state='on'/>
Nov 08 20:10:34 user nova-compute[74638]:   </features>
Nov 08 20:10:34 user nova-compute[74638]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 20:10:34 user nova-compute[74638]:     <model fallback='forbid'>Nehalem</model>
Nov 08 20:10:34 user nova-compute[74638]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 20:10:34 user nova-compute[74638]:     <feature policy='require' name='vme'/>
Nov 08 20:10:34 user nova-compute[74638]:     <feature policy='require' name='x2apic'/>
Nov 08 20:10:34 user nova-compute[74638]:     <feature policy='require' name='hypervisor'/>
Nov 08 20:10:34 user nova-compute[74638]:   </cpu>
Nov 08 20:10:34 user nova-compute[74638]:   <clock offset='utc'>
Nov 08 20:10:34 user nova-compute[74638]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 20:10:34 user nova-compute[74638]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 20:10:34 user nova-compute[74638]:     <timer name='hpet' present='no'/>
Nov 08 20:10:34 user nova-compute[74638]:   </clock>
Nov 08 20:10:34 user nova-compute[74638]:   <on_poweroff>destroy</on_poweroff>
Nov 08 20:10:34 user nova-compute[74638]:   <on_reboot>restart</on_reboot>
Nov 08 20:10:34 user nova-compute[74638]:   <on_crash>destroy</on_crash>
Nov 08 20:10:34 user nova-compute[74638]:   <devices>
Nov 08 20:10:34 user nova-compute[74638]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 20:10:34 user nova-compute[74638]:     <disk type='file' device='disk'>
Nov 08 20:10:34 user nova-compute[74638]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 20:10:34 user nova-compute[74638]:       <source file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk' index='2'/>
Nov 08 20:10:34 user nova-compute[74638]:       <backingStore type='file' index='3'>
Nov 08 20:10:34 user nova-compute[74638]:         <format type='raw'/>
Nov 08 20:10:34 user nova-compute[74638]:         <source file='/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835'/>
Nov 08 20:10:34 user nova-compute[74638]:         <backingStore/>
Nov 08 20:10:34 user nova-compute[74638]:       </backingStore>
Nov 08 20:10:34 user nova-compute[74638]:       <target dev='vda' bus='virtio'/>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='virtio-disk0'/>
Nov 08 20:10:34 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </disk>
Nov 08 20:10:34 user nova-compute[74638]:     <disk type='file' device='cdrom'>
Nov 08 20:10:34 user nova-compute[74638]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 20:10:34 user nova-compute[74638]:       <source file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.config' index='1'/>
Nov 08 20:10:34 user nova-compute[74638]:       <backingStore/>
Nov 08 20:10:34 user nova-compute[74638]:       <target dev='hda' bus='ide'/>
Nov 08 20:10:34 user nova-compute[74638]:       <readonly/>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='ide0-0-0'/>
Nov 08 20:10:34 user nova-compute[74638]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </disk>
Nov 08 20:10:34 user nova-compute[74638]:     <controller type='usb' index='0' model='none'>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='usb'/>
Nov 08 20:10:34 user nova-compute[74638]:     </controller>
Nov 08 20:10:34 user nova-compute[74638]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='pci.0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </controller>
Nov 08 20:10:34 user nova-compute[74638]:     <controller type='ide' index='0'>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='ide'/>
Nov 08 20:10:34 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 20:10:34 user nova-compute[74638]:     </controller>
Nov 08 20:10:34 user nova-compute[74638]:     <interface type='ethernet'>
Nov 08 20:10:34 user nova-compute[74638]:       <mac address='fa:16:3e:a8:67:68'/>
Nov 08 20:10:34 user nova-compute[74638]:       <target dev='tap18e2eb15-f6'/>
Nov 08 20:10:34 user nova-compute[74638]:       <model type='virtio'/>
Nov 08 20:10:34 user nova-compute[74638]:       <mtu size='1442'/>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='net0'/>
Nov 08 20:10:34 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </interface>
Nov 08 20:10:34 user nova-compute[74638]:     <serial type='pty'>
Nov 08 20:10:34 user nova-compute[74638]:       <source path='/dev/pts/6'/>
Nov 08 20:10:34 user nova-compute[74638]:       <log file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log' append='off'/>
Nov 08 20:10:34 user nova-compute[74638]:       <target type='isa-serial' port='0'>
Nov 08 20:10:34 user nova-compute[74638]:         <model name='isa-serial'/>
Nov 08 20:10:34 user nova-compute[74638]:       </target>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='serial0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </serial>
Nov 08 20:10:34 user nova-compute[74638]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 20:10:34 user nova-compute[74638]:       <source path='/dev/pts/6'/>
Nov 08 20:10:34 user nova-compute[74638]:       <log file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log' append='off'/>
Nov 08 20:10:34 user nova-compute[74638]:       <target type='serial' port='0'/>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='serial0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </console>
Nov 08 20:10:34 user nova-compute[74638]:     <input type='mouse' bus='ps2'>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='input0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </input>
Nov 08 20:10:34 user nova-compute[74638]:     <input type='keyboard' bus='ps2'>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='input1'/>
Nov 08 20:10:34 user nova-compute[74638]:     </input>
Nov 08 20:10:34 user nova-compute[74638]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 20:10:34 user nova-compute[74638]:       <listen type='address' address='0.0.0.0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </graphics>
Nov 08 20:10:34 user nova-compute[74638]:     <audio id='1' type='none'/>
Nov 08 20:10:34 user nova-compute[74638]:     <video>
Nov 08 20:10:34 user nova-compute[74638]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='video0'/>
Nov 08 20:10:34 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </video>
Nov 08 20:10:34 user nova-compute[74638]:     <memballoon model='virtio'>
Nov 08 20:10:34 user nova-compute[74638]:       <stats period='10'/>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='balloon0'/>
Nov 08 20:10:34 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </memballoon>
Nov 08 20:10:34 user nova-compute[74638]:     <rng model='virtio'>
Nov 08 20:10:34 user nova-compute[74638]:       <backend model='random'>/dev/urandom</backend>
Nov 08 20:10:34 user nova-compute[74638]:       <alias name='rng0'/>
Nov 08 20:10:34 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 20:10:34 user nova-compute[74638]:     </rng>
Nov 08 20:10:34 user nova-compute[74638]:   </devices>
Nov 08 20:10:34 user nova-compute[74638]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 20:10:34 user nova-compute[74638]:     <label>libvirt-b2192b24-bca8-467c-b408-f6f645d5557f</label>
Nov 08 20:10:34 user nova-compute[74638]:     <imagelabel>libvirt-b2192b24-bca8-467c-b408-f6f645d5557f</imagelabel>
Nov 08 20:10:34 user nova-compute[74638]:   </seclabel>
Nov 08 20:10:34 user nova-compute[74638]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 20:10:34 user nova-compute[74638]:     <label>+64055:+108</label>
Nov 08 20:10:34 user nova-compute[74638]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 20:10:34 user nova-compute[74638]:   </seclabel>
Nov 08 20:10:34 user nova-compute[74638]: </domain>
Nov 08 20:10:34 user nova-compute[74638]:  {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 20:10:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Successfully detached device tapde0772c3-b1 from instance b2192b24-bca8-467c-b408-f6f645d5557f from the live domain config.
Nov 08 20:10:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converting VIF {"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG os_vif [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde0772c3-b1, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f7c441a-d149-479f-9adf-45b895d6e842) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:34 user nova-compute[74638]: INFO os_vif [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1')
Nov 08 20:10:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:10:34 user nova-compute[74638]:   <nova:package version="0.0.0"/>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:name>tempest-device-tagging-server-1887474706</nova:name>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:creationTime>2023-11-08 20:10:34</nova:creationTime>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:flavor name="m1.tiny">
Nov 08 20:10:34 user nova-compute[74638]:     <nova:memory>512</nova:memory>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:disk>1</nova:disk>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:swap>0</nova:swap>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:vcpus>1</nova:vcpus>
Nov 08 20:10:34 user nova-compute[74638]:   </nova:flavor>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:owner>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:user uuid="be705289f5974554ab1d6bc4e66735b5">tempest-TaggedAttachmentsTest-929214679-project-member</nova:user>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:project uuid="f83f180c62c64dcb83c30c7e3e8a5c4e">tempest-TaggedAttachmentsTest-929214679</nova:project>
Nov 08 20:10:34 user nova-compute[74638]:   </nova:owner>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:10:34 user nova-compute[74638]:   <nova:ports>
Nov 08 20:10:34 user nova-compute[74638]:     <nova:port uuid="18e2eb15-f699-42ac-ac84-e6d446f1f59c">
Nov 08 20:10:34 user nova-compute[74638]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:10:34 user nova-compute[74638]:     </nova:port>
Nov 08 20:10:34 user nova-compute[74638]:   </nova:ports>
Nov 08 20:10:34 user nova-compute[74638]: </nova:instance>
Nov 08 20:10:34 user nova-compute[74638]:  {{(pid=74638) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquired lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.network.neutron [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-deleted-de0772c3-b1d6-4307-b55c-494418b9437c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:35 user nova-compute[74638]: INFO nova.compute.manager [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Neutron deleted interface de0772c3-b1d6-4307-b55c-494418b9437c; detaching it from the instance and deleting it from the info cache
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating instance_info_cache with network_info: [{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.objects.instance [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Lazy-loading 'system_metadata' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.objects.instance [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Lazy-loading 'flavor' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.objects.base [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Object Instance<b2192b24-bca8-467c-b408-f6f645d5557f> lazy-loaded attributes: system_metadata,flavor {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Converting VIF {"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface> {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 20:10:35 user nova-compute[74638]:   <name>instance-00000007</name>
Nov 08 20:10:35 user nova-compute[74638]:   <uuid>b2192b24-bca8-467c-b408-f6f645d5557f</uuid>
Nov 08 20:10:35 user nova-compute[74638]:   <metadata>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:10:35 user nova-compute[74638]:   <nova:package version="0.0.0"/>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:name>tempest-device-tagging-server-1887474706</nova:name>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:creationTime>2023-11-08 20:10:34</nova:creationTime>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:flavor name="m1.tiny">
Nov 08 20:10:35 user nova-compute[74638]:     <nova:memory>512</nova:memory>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:disk>1</nova:disk>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:swap>0</nova:swap>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:vcpus>1</nova:vcpus>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:flavor>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:owner>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:user uuid="be705289f5974554ab1d6bc4e66735b5">tempest-TaggedAttachmentsTest-929214679-project-member</nova:user>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:project uuid="f83f180c62c64dcb83c30c7e3e8a5c4e">tempest-TaggedAttachmentsTest-929214679</nova:project>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:owner>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:ports>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:port uuid="18e2eb15-f699-42ac-ac84-e6d446f1f59c">
Nov 08 20:10:35 user nova-compute[74638]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:10:35 user nova-compute[74638]:     </nova:port>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:ports>
Nov 08 20:10:35 user nova-compute[74638]: </nova:instance>
Nov 08 20:10:35 user nova-compute[74638]:   </metadata>
Nov 08 20:10:35 user nova-compute[74638]:   <memory unit='KiB'>524288</memory>
Nov 08 20:10:35 user nova-compute[74638]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 20:10:35 user nova-compute[74638]:   <vcpu placement='static'>1</vcpu>
Nov 08 20:10:35 user nova-compute[74638]:   <resource>
Nov 08 20:10:35 user nova-compute[74638]:     <partition>/machine</partition>
Nov 08 20:10:35 user nova-compute[74638]:   </resource>
Nov 08 20:10:35 user nova-compute[74638]:   <sysinfo type='smbios'>
Nov 08 20:10:35 user nova-compute[74638]:     <system>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='version'>0.0.0</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='serial'>b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='uuid'>b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='family'>Virtual Machine</entry>
Nov 08 20:10:35 user nova-compute[74638]:     </system>
Nov 08 20:10:35 user nova-compute[74638]:   </sysinfo>
Nov 08 20:10:35 user nova-compute[74638]:   <os>
Nov 08 20:10:35 user nova-compute[74638]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 20:10:35 user nova-compute[74638]:     <boot dev='hd'/>
Nov 08 20:10:35 user nova-compute[74638]:     <smbios mode='sysinfo'/>
Nov 08 20:10:35 user nova-compute[74638]:   </os>
Nov 08 20:10:35 user nova-compute[74638]:   <features>
Nov 08 20:10:35 user nova-compute[74638]:     <acpi/>
Nov 08 20:10:35 user nova-compute[74638]:     <apic/>
Nov 08 20:10:35 user nova-compute[74638]:     <vmcoreinfo state='on'/>
Nov 08 20:10:35 user nova-compute[74638]:   </features>
Nov 08 20:10:35 user nova-compute[74638]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 20:10:35 user nova-compute[74638]:     <model fallback='forbid'>Nehalem</model>
Nov 08 20:10:35 user nova-compute[74638]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 20:10:35 user nova-compute[74638]:     <feature policy='require' name='vme'/>
Nov 08 20:10:35 user nova-compute[74638]:     <feature policy='require' name='x2apic'/>
Nov 08 20:10:35 user nova-compute[74638]:     <feature policy='require' name='hypervisor'/>
Nov 08 20:10:35 user nova-compute[74638]:   </cpu>
Nov 08 20:10:35 user nova-compute[74638]:   <clock offset='utc'>
Nov 08 20:10:35 user nova-compute[74638]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 20:10:35 user nova-compute[74638]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 20:10:35 user nova-compute[74638]:     <timer name='hpet' present='no'/>
Nov 08 20:10:35 user nova-compute[74638]:   </clock>
Nov 08 20:10:35 user nova-compute[74638]:   <on_poweroff>destroy</on_poweroff>
Nov 08 20:10:35 user nova-compute[74638]:   <on_reboot>restart</on_reboot>
Nov 08 20:10:35 user nova-compute[74638]:   <on_crash>destroy</on_crash>
Nov 08 20:10:35 user nova-compute[74638]:   <devices>
Nov 08 20:10:35 user nova-compute[74638]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 20:10:35 user nova-compute[74638]:     <disk type='file' device='disk'>
Nov 08 20:10:35 user nova-compute[74638]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 20:10:35 user nova-compute[74638]:       <source file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk' index='2'/>
Nov 08 20:10:35 user nova-compute[74638]:       <backingStore type='file' index='3'>
Nov 08 20:10:35 user nova-compute[74638]:         <format type='raw'/>
Nov 08 20:10:35 user nova-compute[74638]:         <source file='/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835'/>
Nov 08 20:10:35 user nova-compute[74638]:         <backingStore/>
Nov 08 20:10:35 user nova-compute[74638]:       </backingStore>
Nov 08 20:10:35 user nova-compute[74638]:       <target dev='vda' bus='virtio'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='virtio-disk0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </disk>
Nov 08 20:10:35 user nova-compute[74638]:     <disk type='file' device='cdrom'>
Nov 08 20:10:35 user nova-compute[74638]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 20:10:35 user nova-compute[74638]:       <source file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.config' index='1'/>
Nov 08 20:10:35 user nova-compute[74638]:       <backingStore/>
Nov 08 20:10:35 user nova-compute[74638]:       <target dev='hda' bus='ide'/>
Nov 08 20:10:35 user nova-compute[74638]:       <readonly/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='ide0-0-0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </disk>
Nov 08 20:10:35 user nova-compute[74638]:     <controller type='usb' index='0' model='none'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='usb'/>
Nov 08 20:10:35 user nova-compute[74638]:     </controller>
Nov 08 20:10:35 user nova-compute[74638]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='pci.0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </controller>
Nov 08 20:10:35 user nova-compute[74638]:     <controller type='ide' index='0'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='ide'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 20:10:35 user nova-compute[74638]:     </controller>
Nov 08 20:10:35 user nova-compute[74638]:     <interface type='ethernet'>
Nov 08 20:10:35 user nova-compute[74638]:       <mac address='fa:16:3e:a8:67:68'/>
Nov 08 20:10:35 user nova-compute[74638]:       <target dev='tap18e2eb15-f6'/>
Nov 08 20:10:35 user nova-compute[74638]:       <model type='virtio'/>
Nov 08 20:10:35 user nova-compute[74638]:       <mtu size='1442'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='net0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </interface>
Nov 08 20:10:35 user nova-compute[74638]:     <serial type='pty'>
Nov 08 20:10:35 user nova-compute[74638]:       <source path='/dev/pts/6'/>
Nov 08 20:10:35 user nova-compute[74638]:       <log file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log' append='off'/>
Nov 08 20:10:35 user nova-compute[74638]:       <target type='isa-serial' port='0'>
Nov 08 20:10:35 user nova-compute[74638]:         <model name='isa-serial'/>
Nov 08 20:10:35 user nova-compute[74638]:       </target>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='serial0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </serial>
Nov 08 20:10:35 user nova-compute[74638]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 20:10:35 user nova-compute[74638]:       <source path='/dev/pts/6'/>
Nov 08 20:10:35 user nova-compute[74638]:       <log file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log' append='off'/>
Nov 08 20:10:35 user nova-compute[74638]:       <target type='serial' port='0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='serial0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </console>
Nov 08 20:10:35 user nova-compute[74638]:     <input type='mouse' bus='ps2'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='input0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </input>
Nov 08 20:10:35 user nova-compute[74638]:     <input type='keyboard' bus='ps2'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='input1'/>
Nov 08 20:10:35 user nova-compute[74638]:     </input>
Nov 08 20:10:35 user nova-compute[74638]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 20:10:35 user nova-compute[74638]:       <listen type='address' address='0.0.0.0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </graphics>
Nov 08 20:10:35 user nova-compute[74638]:     <audio id='1' type='none'/>
Nov 08 20:10:35 user nova-compute[74638]:     <video>
Nov 08 20:10:35 user nova-compute[74638]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='video0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </video>
Nov 08 20:10:35 user nova-compute[74638]:     <memballoon model='virtio'>
Nov 08 20:10:35 user nova-compute[74638]:       <stats period='10'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='balloon0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </memballoon>
Nov 08 20:10:35 user nova-compute[74638]:     <rng model='virtio'>
Nov 08 20:10:35 user nova-compute[74638]:       <backend model='random'>/dev/urandom</backend>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='rng0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </rng>
Nov 08 20:10:35 user nova-compute[74638]:   </devices>
Nov 08 20:10:35 user nova-compute[74638]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 20:10:35 user nova-compute[74638]:     <label>libvirt-b2192b24-bca8-467c-b408-f6f645d5557f</label>
Nov 08 20:10:35 user nova-compute[74638]:     <imagelabel>libvirt-b2192b24-bca8-467c-b408-f6f645d5557f</imagelabel>
Nov 08 20:10:35 user nova-compute[74638]:   </seclabel>
Nov 08 20:10:35 user nova-compute[74638]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 20:10:35 user nova-compute[74638]:     <label>+64055:+108</label>
Nov 08 20:10:35 user nova-compute[74638]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 20:10:35 user nova-compute[74638]:   </seclabel>
Nov 08 20:10:35 user nova-compute[74638]: </domain>
Nov 08 20:10:35 user nova-compute[74638]:  {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface> {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:46:05:1d"/><model type="virtio"/><mtu size="1442"/><target dev="tapde0772c3-b1"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 20:10:35 user nova-compute[74638]:   <name>instance-00000007</name>
Nov 08 20:10:35 user nova-compute[74638]:   <uuid>b2192b24-bca8-467c-b408-f6f645d5557f</uuid>
Nov 08 20:10:35 user nova-compute[74638]:   <metadata>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:10:35 user nova-compute[74638]:   <nova:package version="0.0.0"/>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:name>tempest-device-tagging-server-1887474706</nova:name>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:creationTime>2023-11-08 20:10:34</nova:creationTime>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:flavor name="m1.tiny">
Nov 08 20:10:35 user nova-compute[74638]:     <nova:memory>512</nova:memory>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:disk>1</nova:disk>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:swap>0</nova:swap>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:vcpus>1</nova:vcpus>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:flavor>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:owner>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:user uuid="be705289f5974554ab1d6bc4e66735b5">tempest-TaggedAttachmentsTest-929214679-project-member</nova:user>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:project uuid="f83f180c62c64dcb83c30c7e3e8a5c4e">tempest-TaggedAttachmentsTest-929214679</nova:project>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:owner>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:ports>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:port uuid="18e2eb15-f699-42ac-ac84-e6d446f1f59c">
Nov 08 20:10:35 user nova-compute[74638]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:10:35 user nova-compute[74638]:     </nova:port>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:ports>
Nov 08 20:10:35 user nova-compute[74638]: </nova:instance>
Nov 08 20:10:35 user nova-compute[74638]:   </metadata>
Nov 08 20:10:35 user nova-compute[74638]:   <memory unit='KiB'>524288</memory>
Nov 08 20:10:35 user nova-compute[74638]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 20:10:35 user nova-compute[74638]:   <vcpu placement='static'>1</vcpu>
Nov 08 20:10:35 user nova-compute[74638]:   <resource>
Nov 08 20:10:35 user nova-compute[74638]:     <partition>/machine</partition>
Nov 08 20:10:35 user nova-compute[74638]:   </resource>
Nov 08 20:10:35 user nova-compute[74638]:   <sysinfo type='smbios'>
Nov 08 20:10:35 user nova-compute[74638]:     <system>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='version'>0.0.0</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='serial'>b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='uuid'>b2192b24-bca8-467c-b408-f6f645d5557f</entry>
Nov 08 20:10:35 user nova-compute[74638]:       <entry name='family'>Virtual Machine</entry>
Nov 08 20:10:35 user nova-compute[74638]:     </system>
Nov 08 20:10:35 user nova-compute[74638]:   </sysinfo>
Nov 08 20:10:35 user nova-compute[74638]:   <os>
Nov 08 20:10:35 user nova-compute[74638]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 20:10:35 user nova-compute[74638]:     <boot dev='hd'/>
Nov 08 20:10:35 user nova-compute[74638]:     <smbios mode='sysinfo'/>
Nov 08 20:10:35 user nova-compute[74638]:   </os>
Nov 08 20:10:35 user nova-compute[74638]:   <features>
Nov 08 20:10:35 user nova-compute[74638]:     <acpi/>
Nov 08 20:10:35 user nova-compute[74638]:     <apic/>
Nov 08 20:10:35 user nova-compute[74638]:     <vmcoreinfo state='on'/>
Nov 08 20:10:35 user nova-compute[74638]:   </features>
Nov 08 20:10:35 user nova-compute[74638]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 20:10:35 user nova-compute[74638]:     <model fallback='forbid'>Nehalem</model>
Nov 08 20:10:35 user nova-compute[74638]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 20:10:35 user nova-compute[74638]:     <feature policy='require' name='vme'/>
Nov 08 20:10:35 user nova-compute[74638]:     <feature policy='require' name='x2apic'/>
Nov 08 20:10:35 user nova-compute[74638]:     <feature policy='require' name='hypervisor'/>
Nov 08 20:10:35 user nova-compute[74638]:   </cpu>
Nov 08 20:10:35 user nova-compute[74638]:   <clock offset='utc'>
Nov 08 20:10:35 user nova-compute[74638]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 20:10:35 user nova-compute[74638]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 20:10:35 user nova-compute[74638]:     <timer name='hpet' present='no'/>
Nov 08 20:10:35 user nova-compute[74638]:   </clock>
Nov 08 20:10:35 user nova-compute[74638]:   <on_poweroff>destroy</on_poweroff>
Nov 08 20:10:35 user nova-compute[74638]:   <on_reboot>restart</on_reboot>
Nov 08 20:10:35 user nova-compute[74638]:   <on_crash>destroy</on_crash>
Nov 08 20:10:35 user nova-compute[74638]:   <devices>
Nov 08 20:10:35 user nova-compute[74638]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 20:10:35 user nova-compute[74638]:     <disk type='file' device='disk'>
Nov 08 20:10:35 user nova-compute[74638]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 20:10:35 user nova-compute[74638]:       <source file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk' index='2'/>
Nov 08 20:10:35 user nova-compute[74638]:       <backingStore type='file' index='3'>
Nov 08 20:10:35 user nova-compute[74638]:         <format type='raw'/>
Nov 08 20:10:35 user nova-compute[74638]:         <source file='/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835'/>
Nov 08 20:10:35 user nova-compute[74638]:         <backingStore/>
Nov 08 20:10:35 user nova-compute[74638]:       </backingStore>
Nov 08 20:10:35 user nova-compute[74638]:       <target dev='vda' bus='virtio'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='virtio-disk0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </disk>
Nov 08 20:10:35 user nova-compute[74638]:     <disk type='file' device='cdrom'>
Nov 08 20:10:35 user nova-compute[74638]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 20:10:35 user nova-compute[74638]:       <source file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk.config' index='1'/>
Nov 08 20:10:35 user nova-compute[74638]:       <backingStore/>
Nov 08 20:10:35 user nova-compute[74638]:       <target dev='hda' bus='ide'/>
Nov 08 20:10:35 user nova-compute[74638]:       <readonly/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='ide0-0-0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </disk>
Nov 08 20:10:35 user nova-compute[74638]:     <controller type='usb' index='0' model='none'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='usb'/>
Nov 08 20:10:35 user nova-compute[74638]:     </controller>
Nov 08 20:10:35 user nova-compute[74638]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='pci.0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </controller>
Nov 08 20:10:35 user nova-compute[74638]:     <controller type='ide' index='0'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='ide'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 20:10:35 user nova-compute[74638]:     </controller>
Nov 08 20:10:35 user nova-compute[74638]:     <interface type='ethernet'>
Nov 08 20:10:35 user nova-compute[74638]:       <mac address='fa:16:3e:a8:67:68'/>
Nov 08 20:10:35 user nova-compute[74638]:       <target dev='tap18e2eb15-f6'/>
Nov 08 20:10:35 user nova-compute[74638]:       <model type='virtio'/>
Nov 08 20:10:35 user nova-compute[74638]:       <mtu size='1442'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='net0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </interface>
Nov 08 20:10:35 user nova-compute[74638]:     <serial type='pty'>
Nov 08 20:10:35 user nova-compute[74638]:       <source path='/dev/pts/6'/>
Nov 08 20:10:35 user nova-compute[74638]:       <log file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log' append='off'/>
Nov 08 20:10:35 user nova-compute[74638]:       <target type='isa-serial' port='0'>
Nov 08 20:10:35 user nova-compute[74638]:         <model name='isa-serial'/>
Nov 08 20:10:35 user nova-compute[74638]:       </target>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='serial0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </serial>
Nov 08 20:10:35 user nova-compute[74638]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 20:10:35 user nova-compute[74638]:       <source path='/dev/pts/6'/>
Nov 08 20:10:35 user nova-compute[74638]:       <log file='/opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/console.log' append='off'/>
Nov 08 20:10:35 user nova-compute[74638]:       <target type='serial' port='0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='serial0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </console>
Nov 08 20:10:35 user nova-compute[74638]:     <input type='mouse' bus='ps2'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='input0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </input>
Nov 08 20:10:35 user nova-compute[74638]:     <input type='keyboard' bus='ps2'>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='input1'/>
Nov 08 20:10:35 user nova-compute[74638]:     </input>
Nov 08 20:10:35 user nova-compute[74638]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 20:10:35 user nova-compute[74638]:       <listen type='address' address='0.0.0.0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </graphics>
Nov 08 20:10:35 user nova-compute[74638]:     <audio id='1' type='none'/>
Nov 08 20:10:35 user nova-compute[74638]:     <video>
Nov 08 20:10:35 user nova-compute[74638]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='video0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </video>
Nov 08 20:10:35 user nova-compute[74638]:     <memballoon model='virtio'>
Nov 08 20:10:35 user nova-compute[74638]:       <stats period='10'/>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='balloon0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </memballoon>
Nov 08 20:10:35 user nova-compute[74638]:     <rng model='virtio'>
Nov 08 20:10:35 user nova-compute[74638]:       <backend model='random'>/dev/urandom</backend>
Nov 08 20:10:35 user nova-compute[74638]:       <alias name='rng0'/>
Nov 08 20:10:35 user nova-compute[74638]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 20:10:35 user nova-compute[74638]:     </rng>
Nov 08 20:10:35 user nova-compute[74638]:   </devices>
Nov 08 20:10:35 user nova-compute[74638]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 20:10:35 user nova-compute[74638]:     <label>libvirt-b2192b24-bca8-467c-b408-f6f645d5557f</label>
Nov 08 20:10:35 user nova-compute[74638]:     <imagelabel>libvirt-b2192b24-bca8-467c-b408-f6f645d5557f</imagelabel>
Nov 08 20:10:35 user nova-compute[74638]:   </seclabel>
Nov 08 20:10:35 user nova-compute[74638]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 20:10:35 user nova-compute[74638]:     <label>+64055:+108</label>
Nov 08 20:10:35 user nova-compute[74638]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 20:10:35 user nova-compute[74638]:   </seclabel>
Nov 08 20:10:35 user nova-compute[74638]: </domain>
Nov 08 20:10:35 user nova-compute[74638]:  {{(pid=74638) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 20:10:35 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Detaching interface fa:16:3e:46:05:1d failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapde0772c3-b1' not found.
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Converting VIF {"id": "de0772c3-b1d6-4307-b55c-494418b9437c", "address": "fa:16:3e:46:05:1d", "network": {"id": "8924bf60-8b64-4ac9-970e-4d265d9b61bb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-882119005", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0772c3-b1", "ovs_interfaceid": "de0772c3-b1d6-4307-b55c-494418b9437c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG os_vif [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde0772c3-b1, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:10:35 user nova-compute[74638]: INFO os_vif [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:05:1d,bridge_name='br-int',has_traffic_filtering=True,id=de0772c3-b1d6-4307-b55c-494418b9437c,network=Network(8924bf60-8b64-4ac9-970e-4d265d9b61bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0772c3-b1')
Nov 08 20:10:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [req-1b004c12-ec90-4b23-8789-8484092393b6 req-94cbe8c9-c1ff-4807-9431-8775b9969370 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:10:35 user nova-compute[74638]:   <nova:package version="0.0.0"/>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:name>tempest-device-tagging-server-1887474706</nova:name>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:creationTime>2023-11-08 20:10:35</nova:creationTime>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:flavor name="m1.tiny">
Nov 08 20:10:35 user nova-compute[74638]:     <nova:memory>512</nova:memory>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:disk>1</nova:disk>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:swap>0</nova:swap>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:vcpus>1</nova:vcpus>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:flavor>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:owner>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:user uuid="be705289f5974554ab1d6bc4e66735b5">tempest-TaggedAttachmentsTest-929214679-project-member</nova:user>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:project uuid="f83f180c62c64dcb83c30c7e3e8a5c4e">tempest-TaggedAttachmentsTest-929214679</nova:project>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:owner>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:10:35 user nova-compute[74638]:   <nova:ports>
Nov 08 20:10:35 user nova-compute[74638]:     <nova:port uuid="18e2eb15-f699-42ac-ac84-e6d446f1f59c">
Nov 08 20:10:35 user nova-compute[74638]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:10:35 user nova-compute[74638]:     </nova:port>
Nov 08 20:10:35 user nova-compute[74638]:   </nova:ports>
Nov 08 20:10:35 user nova-compute[74638]: </nova:instance>
Nov 08 20:10:35 user nova-compute[74638]:  {{(pid=74638) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 20:10:36 user nova-compute[74638]: INFO nova.network.neutron [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Port de0772c3-b1d6-4307-b55c-494418b9437c from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 08 20:10:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating instance_info_cache with network_info: [{"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:10:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Releasing lock "refresh_cache-b2192b24-bca8-467c-b408-f6f645d5557f" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:10:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-cceb1b29-7985-4506-be13-34ccf341c624 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "interface-b2192b24-bca8-467c-b408-f6f645d5557f-de0772c3-b1d6-4307-b55c-494418b9437c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.183s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:10:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:10:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxAMTYoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:10:45 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:45 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:10:45 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4fe60c-6f4f-4e95-9d52-da2313db2585]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:10:45 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e16ec1-f9fc-45df-893f-497e1ebc365d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d] added
Nov 08 20:10:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3048fc-6259-4281-926f-af052cac3314]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d59b0fb-2738-44b0-9011-0c3ce8175740]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vxAMTYoP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vxAMTYoP" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[80001e73-964a-4fab-a66e-c97230d65e77]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vxAMTYoP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f5162a-e6f6-4f40-a36a-2d2c04ca9963]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ed2bc1-b364-4a14-97ba-59feeb5bb60f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcd3464-03cd-497d-a295-6be3623a0092]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d, portal: 172.16.0.220,3260]
Nov 08 20:10:45 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d, portal: 172.16.0.220,3260] successful.
Nov 08 20:10:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[022c3c63-d62d-49a0-87a1-4305b25a6668]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2434dd41-f10e-49d8-87a5-6b8f08bb95f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:10:45 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:10:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc52a9-dcc5-42a6-973e-fabf939d4ee7]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:10:45 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:10:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxAMTYoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:10:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:10:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23764663939643931', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:10:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764663939643931', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:10:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lazy-loading 'flavor' on Instance uuid 204d636f-c342-45df-a083-7aa388a62c54 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:10:46 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:10:46 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:10:46 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:10:46 user nova-compute[74638]:   <serial>183f4be4-ff4a-4363-a808-fc87944f771d</serial>
Nov 08 20:10:46 user nova-compute[74638]: </disk>
Nov 08 20:10:46 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:10:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:10:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:10:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] No VIF found with MAC fa:16:3e:6f:24:cf, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:10:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f76f3940-21f6-472e-8885-914f5d24e85f tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.623s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:50 user nova-compute[74638]: INFO nova.compute.manager [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Detaching volume 183f4be4-ff4a-4363-a808-fc87944f771d
Nov 08 20:10:50 user nova-compute[74638]: INFO nova.virt.block_device [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Attempting to driver detach volume 183f4be4-ff4a-4363-a808-fc87944f771d from mountpoint /dev/vdb
Nov 08 20:10:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Attempting to detach device vdb from instance 204d636f-c342-45df-a083-7aa388a62c54 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:10:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:10:50 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:10:50 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:10:50 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:10:50 user nova-compute[74638]:   <serial>183f4be4-ff4a-4363-a808-fc87944f771d</serial>
Nov 08 20:10:50 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:10:50 user nova-compute[74638]: </disk>
Nov 08 20:10:50 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:10:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Successfully detached device vdb from instance 204d636f-c342-45df-a083-7aa388a62c54 from the persistent domain config.
Nov 08 20:10:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 204d636f-c342-45df-a083-7aa388a62c54 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:10:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:10:50 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:10:50 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:10:50 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:10:50 user nova-compute[74638]:   <serial>183f4be4-ff4a-4363-a808-fc87944f771d</serial>
Nov 08 20:10:50 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:10:50 user nova-compute[74638]: </disk>
Nov 08 20:10:50 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:10:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 204d636f-c342-45df-a083-7aa388a62c54 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:10:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:53 user nova-compute[74638]: INFO nova.compute.manager [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Terminating instance
Nov 08 20:10:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-5c6fe893-4371-4f99-a187-6e407b560994 req-d8e7eb47-b2a4-4727-a52b-4a8d8f9dc460 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received event network-vif-unplugged-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5c6fe893-4371-4f99-a187-6e407b560994 req-d8e7eb47-b2a4-4727-a52b-4a8d8f9dc460 service nova] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5c6fe893-4371-4f99-a187-6e407b560994 req-d8e7eb47-b2a4-4727-a52b-4a8d8f9dc460 service nova] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5c6fe893-4371-4f99-a187-6e407b560994 req-d8e7eb47-b2a4-4727-a52b-4a8d8f9dc460 service nova] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-5c6fe893-4371-4f99-a187-6e407b560994 req-d8e7eb47-b2a4-4727-a52b-4a8d8f9dc460 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] No waiting events found dispatching network-vif-unplugged-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-5c6fe893-4371-4f99-a187-6e407b560994 req-d8e7eb47-b2a4-4727-a52b-4a8d8f9dc460 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received event network-vif-unplugged-df85f533-347b-49e1-bab5-5bd28eb584f0 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:10:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Instance destroyed successfully.
Nov 08 20:10:54 user nova-compute[74638]: DEBUG nova.objects.instance [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lazy-loading 'resources' on Instance uuid 03d6123e-19ab-4fcf-9df5-770ca5e30422 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1687685711',display_name='tempest-VolumesAssistedSnapshotsTest-server-1687685711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1687685711',id=9,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Mem4B6J0AiaVvWanP0bS8E8qVPlmxgP+rMqm1r8Zmodb9b58xvTBuq+63fBivZOJmpwRIfu7RzWtF7rZHhAwltv2wzg66LSFp797gy4Qwie3f/gIJJqGvDs3KKAM7xQ==',key_name='tempest-keypair-99988218',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb598f0e209b4d56b65c1d505983dfa3',ramdisk_id='',reservation_id='r-cd04m0jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1643410518',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1643410518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6f6f6751f3748edb79062052cab2b3e',uuid=03d6123e-19ab-4fcf-9df5-770ca5e30422,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Converting VIF {"id": "df85f533-347b-49e1-bab5-5bd28eb584f0", "address": "fa:16:3e:2e:e4:84", "network": {"id": "56416715-5ac0-436f-9a82-3ce7220008e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2080302638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb598f0e209b4d56b65c1d505983dfa3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf85f533-34", "ovs_interfaceid": "df85f533-347b-49e1-bab5-5bd28eb584f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e4:84,bridge_name='br-int',has_traffic_filtering=True,id=df85f533-347b-49e1-bab5-5bd28eb584f0,network=Network(56416715-5ac0-436f-9a82-3ce7220008e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf85f533-34') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG os_vif [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e4:84,bridge_name='br-int',has_traffic_filtering=True,id=df85f533-347b-49e1-bab5-5bd28eb584f0,network=Network(56416715-5ac0-436f-9a82-3ce7220008e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf85f533-34') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf85f533-34, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=614fe6cd-a832-4304-b656-1e95a210ece9) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:54 user nova-compute[74638]: INFO os_vif [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e4:84,bridge_name='br-int',has_traffic_filtering=True,id=df85f533-347b-49e1-bab5-5bd28eb584f0,network=Network(56416715-5ac0-436f-9a82-3ce7220008e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf85f533-34')
Nov 08 20:10:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Deleting instance files /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422_del
Nov 08 20:10:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Deletion of /opt/stack/data/nova/instances/03d6123e-19ab-4fcf-9df5-770ca5e30422_del complete
Nov 08 20:10:54 user nova-compute[74638]: INFO nova.compute.manager [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 08 20:10:54 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:10:54 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:10:55 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Took 0.89 seconds to deallocate network for instance.
Nov 08 20:10:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-c07f6a9d-4e85-4c7e-bbd1-6bfd76bd4f04 req-4ca2e93e-c564-4dda-8ab3-03c9e3294d54 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received event network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c07f6a9d-4e85-4c7e-bbd1-6bfd76bd4f04 req-4ca2e93e-c564-4dda-8ab3-03c9e3294d54 service nova] Acquiring lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c07f6a9d-4e85-4c7e-bbd1-6bfd76bd4f04 req-4ca2e93e-c564-4dda-8ab3-03c9e3294d54 service nova] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c07f6a9d-4e85-4c7e-bbd1-6bfd76bd4f04 req-4ca2e93e-c564-4dda-8ab3-03c9e3294d54 service nova] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-c07f6a9d-4e85-4c7e-bbd1-6bfd76bd4f04 req-4ca2e93e-c564-4dda-8ab3-03c9e3294d54 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] No waiting events found dispatching network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:10:55 user nova-compute[74638]: WARNING nova.compute.manager [req-c07f6a9d-4e85-4c7e-bbd1-6bfd76bd4f04 req-4ca2e93e-c564-4dda-8ab3-03c9e3294d54 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received unexpected event network-vif-plugged-df85f533-347b-49e1-bab5-5bd28eb584f0 for instance with vm_state deleted and task_state None.
Nov 08 20:10:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-c07f6a9d-4e85-4c7e-bbd1-6bfd76bd4f04 req-4ca2e93e-c564-4dda-8ab3-03c9e3294d54 service nova] [instance: 03d6123e-19ab-4fcf-9df5-770ca5e30422] Received event network-vif-deleted-df85f533-347b-49e1-bab5-5bd28eb584f0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:10:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:55 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Deleted allocations for instance 03d6123e-19ab-4fcf-9df5-770ca5e30422
Nov 08 20:10:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb0101b1-e44c-46c8-aba7-693d48dc31fa tempest-VolumesAssistedSnapshotsTest-1643410518 tempest-VolumesAssistedSnapshotsTest-1643410518-project-member] Lock "03d6123e-19ab-4fcf-9df5-770ca5e30422" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.676s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:10:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:10:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:00 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:11:00 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=25.603317260742188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 10037bd1-d710-4ce1-abe8-b1f5b657c828 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance b2192b24-bca8-467c-b408-f6f645d5557f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 24b78656-ca13-42c8-b45c-e0c1526c1fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a690cfa9-2a34-43a9-843b-e7548703a5e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 204d636f-c342-45df-a083-7aa388a62c54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a8f5663b-ac6f-4037-96c8-94152295e07e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:11:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:11:01 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:11:01 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:11:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:11:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:05 user nova-compute[74638]: INFO nova.compute.manager [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Terminating instance
Nov 08 20:11:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-f992ee53-c10b-458d-9975-c70412468739 req-9dcefc90-4b08-4926-8798-81009062e099 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-unplugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f992ee53-c10b-458d-9975-c70412468739 req-9dcefc90-4b08-4926-8798-81009062e099 service nova] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f992ee53-c10b-458d-9975-c70412468739 req-9dcefc90-4b08-4926-8798-81009062e099 service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f992ee53-c10b-458d-9975-c70412468739 req-9dcefc90-4b08-4926-8798-81009062e099 service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-f992ee53-c10b-458d-9975-c70412468739 req-9dcefc90-4b08-4926-8798-81009062e099 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] No waiting events found dispatching network-vif-unplugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:11:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-f992ee53-c10b-458d-9975-c70412468739 req-9dcefc90-4b08-4926-8798-81009062e099 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-unplugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:11:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Instance destroyed successfully.
Nov 08 20:11:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lazy-loading 'resources' on Instance uuid b2192b24-bca8-467c-b408-f6f645d5557f {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1887474706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1887474706',id=7,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcurJvsdhGbX+/gL3RfEATPiUz3u7a+nlUSFlZr9mVjOMAGcdy/fya9RJwRDA+e9Fj02SrKaBWvTnkofHKUBSLj9vsux5tbb5QnnEojLyFjD1qqIB73hr/O6kXfLrw1YA==',key_name='tempest-keypair-2084209645',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f83f180c62c64dcb83c30c7e3e8a5c4e',ramdisk_id='',reservation_id='r-07fpvik6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-929214679',owner_user_name='tempest-TaggedAttachmentsTest-929214679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be705289f5974554ab1d6bc4e66735b5',uuid=b2192b24-bca8-467c-b408-f6f645d5557f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converting VIF {"id": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "address": "fa:16:3e:a8:67:68", "network": {"id": "0a22ac6f-9ea5-4bfc-8abc-aacfd4772510", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1231420442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f83f180c62c64dcb83c30c7e3e8a5c4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18e2eb15-f6", "ovs_interfaceid": "18e2eb15-f699-42ac-ac84-e6d446f1f59c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:67:68,bridge_name='br-int',has_traffic_filtering=True,id=18e2eb15-f699-42ac-ac84-e6d446f1f59c,network=Network(0a22ac6f-9ea5-4bfc-8abc-aacfd4772510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e2eb15-f6') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG os_vif [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:67:68,bridge_name='br-int',has_traffic_filtering=True,id=18e2eb15-f699-42ac-ac84-e6d446f1f59c,network=Network(0a22ac6f-9ea5-4bfc-8abc-aacfd4772510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e2eb15-f6') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18e2eb15-f6, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d40ba06f-7847-4d2e-a43d-2ce5bee0d758) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:06 user nova-compute[74638]: INFO os_vif [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:67:68,bridge_name='br-int',has_traffic_filtering=True,id=18e2eb15-f699-42ac-ac84-e6d446f1f59c,network=Network(0a22ac6f-9ea5-4bfc-8abc-aacfd4772510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18e2eb15-f6')
Nov 08 20:11:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Deleting instance files /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f_del
Nov 08 20:11:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Deletion of /opt/stack/data/nova/instances/b2192b24-bca8-467c-b408-f6f645d5557f_del complete
Nov 08 20:11:06 user nova-compute[74638]: INFO nova.compute.manager [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 20:11:06 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:11:06 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:11:07 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:11:07 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Took 1.27 seconds to deallocate network for instance.
Nov 08 20:11:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-c7425e87-4f0b-45ad-8d9b-05b4b680353f req-539ea6f4-9339-4a43-9ec4-cc96dd9f3ea0 service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-deleted-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-06521113-5e69-4bb2-933c-636e8cd135bf req-747ca0d5-3c23-4c88-a9eb-3bdfff9eddcb service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received event network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-06521113-5e69-4bb2-933c-636e8cd135bf req-747ca0d5-3c23-4c88-a9eb-3bdfff9eddcb service nova] Acquiring lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-06521113-5e69-4bb2-933c-636e8cd135bf req-747ca0d5-3c23-4c88-a9eb-3bdfff9eddcb service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-06521113-5e69-4bb2-933c-636e8cd135bf req-747ca0d5-3c23-4c88-a9eb-3bdfff9eddcb service nova] Lock "b2192b24-bca8-467c-b408-f6f645d5557f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-06521113-5e69-4bb2-933c-636e8cd135bf req-747ca0d5-3c23-4c88-a9eb-3bdfff9eddcb service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] No waiting events found dispatching network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:11:07 user nova-compute[74638]: WARNING nova.compute.manager [req-06521113-5e69-4bb2-933c-636e8cd135bf req-747ca0d5-3c23-4c88-a9eb-3bdfff9eddcb service nova] [instance: b2192b24-bca8-467c-b408-f6f645d5557f] Received unexpected event network-vif-plugged-18e2eb15-f699-42ac-ac84-e6d446f1f59c for instance with vm_state deleted and task_state None.
Nov 08 20:11:08 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:11:08 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:11:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:08 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Deleted allocations for instance b2192b24-bca8-467c-b408-f6f645d5557f
Nov 08 20:11:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5ea6039e-715e-4f88-be64-52af414676d9 tempest-TaggedAttachmentsTest-929214679 tempest-TaggedAttachmentsTest-929214679-project-member] Lock "b2192b24-bca8-467c-b408-f6f645d5557f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:10 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 204d636f-c342-45df-a083-7aa388a62c54 is timed out.
Nov 08 20:11:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Successfully detached device vdb from instance 204d636f-c342-45df-a083-7aa388a62c54 from the live domain config.
Nov 08 20:11:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vxAMTYoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:11:10 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bfea34-9a44-415b-ae1f-9372992c517b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:11:10 user nova-compute[74638]: No targets found.
Nov 08 20:11:10 user nova-compute[74638]: iSNS:
Nov 08 20:11:10 user nova-compute[74638]: No targets found.
Nov 08 20:11:10 user nova-compute[74638]: STATIC:
Nov 08 20:11:10 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05
Nov 08 20:11:10 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:10 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:10 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d
Nov 08 20:11:10 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:10 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:10 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9
Nov 08 20:11:10 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:10 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:10 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf
Nov 08 20:11:10 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:10 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:10 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1
Nov 08 20:11:10 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:10 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:10 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:11:10 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:10 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:10 user nova-compute[74638]: FIRMWARE:
Nov 08 20:11:10 user nova-compute[74638]: No targets found.
Nov 08 20:11:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:11:10 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:11:10 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[25069030-6390-4ee6-8e37-4099c97300ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35464f0-9030-403a-85c4-24d32523d6f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:11:10 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c011510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c655ea-c1ee-4cb0-b025-17616001d2ba]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dfcae9-c0ec-49a7-9a81-579b4345b9c0]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af663a-05e2-4380-b76d-b66da75917df]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28e89f3-7d98-4b6e-9841-c60c7d3d03f5]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5e4c04-f29f-4f79-8c16-d35564ab5f47]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d880d1-2de4-4d32-914b-9ae2cce22906]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d, portal: 172.16.0.220,3260]
Nov 08 20:11:10 user nova-compute[74638]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d, portal: 172.16.0.220,3260] successful.
Nov 08 20:11:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183f4be4-ff4a-4363-a808-fc87944f771d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba633b3d-0580-4a23-8d3d-e7a165c53e2d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:11:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] <== disconnect_volume: return (356ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:11:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:11:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:11 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lazy-loading 'flavor' on Instance uuid 204d636f-c342-45df-a083-7aa388a62c54 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a54f46e8-c51a-4f46-acef-9af33b48531c tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG nova.compute.manager [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24b78656-ca13-42c8-b45c-e0c1526c1fee', 'attached_at': '', 'detached_at': '', 'volume_id': '9f55b694-5668-468b-87db-dd20af9c0eee', 'serial': '9f55b694-5668-468b-87db-dd20af9c0eee'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKhUgmHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'de3f1df7-03b4-46f8-b7fe-77402aa88e05'}, 'status': 'reserved', 'instance': '24b78656-ca13-42c8-b45c-e0c1526c1fee', 'attached_at': '', 'detached_at': '', 'volume_id': 'de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'serial'} {{(pid=74638) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:11:12 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:11:12 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:11:12 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7188a60c-3e8d-44d1-be27-4a1779cf19e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:11:12 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.241s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d505565e-28cb-4b84-9a33-3bdf6d1f8a52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee] added
Nov 08 20:11:12 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5c0a3a-c972-4eef-9a13-ba3ca0c5b28a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[92af46f6-4876-461a-a29d-870c87c9dd04]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yuOTNZCB {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yuOTNZCB" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0210b3f-f86c-4023-9e46-b35212cdb837]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yuOTNZCB'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1f46e-a2ab-49cf-a5e5-5a1b03757602]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bfb833-4c0d-4f0d-8b95-3ad1abb1a13a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:12 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:12 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbe318f-3d7b-48f7-896f-c88107f7b87b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260]
Nov 08 20:11:12 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260] successful.
Nov 08 20:11:12 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2d56ea-ac6a-40d0-8d65-693cb49662c3]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0749f02d-7b8e-4fd1-888b-40cb0a359ac8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:12 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:11:12 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:12 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.530s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a3b24b-0944-41a7-9451-5e362ce77b51]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:11:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:11:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:11:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.565s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:11:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] <== connect_volume: return (1567ms) {'type': 'block', 'scsi_wwn': '23366633766346565', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:11:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366633766346565', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:11:13 user nova-compute[74638]: DEBUG nova.objects.instance [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lazy-loading 'flavor' on Instance uuid 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 112197632 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 251658240 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 407896064 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 724566016 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 869269504 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 1041235968 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKhUgmHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'de3f1df7-03b4-46f8-b7fe-77402aa88e05'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:11:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[979a84a0-5f4c-4dc2-bf28-bffa63f90867]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:11:18 user nova-compute[74638]: No targets found.
Nov 08 20:11:18 user nova-compute[74638]: iSNS:
Nov 08 20:11:18 user nova-compute[74638]: No targets found.
Nov 08 20:11:18 user nova-compute[74638]: STATIC:
Nov 08 20:11:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05
Nov 08 20:11:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:11:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9
Nov 08 20:11:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf
Nov 08 20:11:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1
Nov 08 20:11:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:11:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:18 user nova-compute[74638]: FIRMWARE:
Nov 08 20:11:18 user nova-compute[74638]: No targets found.
Nov 08 20:11:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:11:18 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:11:18 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c555c5d-9a51-4714-b821-026370b140d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19b69ab-d5fc-4ca1-8328-881580df7c24]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 (non-flash)
Nov 08 20:11:18 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c71c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fd3b42-a663-409d-855b-4a2c44d63c11]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[778204fd-f9ae-4832-b086-2d65e7e758eb]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ee1041-f9d9-43e5-ac51-94a2f43dd91c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaba40d3-5d83-4d98-a8a8-c2e77367e3c1]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2799194-eaff-4f42-820d-0c3f897853e7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f9b3fe-94d0-4d27-af5f-be29dc9e9da7]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05, portal: 172.16.0.220,3260]
Nov 08 20:11:18 user nova-compute[74638]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05, portal: 172.16.0.220,3260] successful.
Nov 08 20:11:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3f1df7-03b4-46f8-b7fe-77402aa88e05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf77b71b-898d-4af2-8fd5-f8f5d8acf6f1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] <== disconnect_volume: return (314ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '24b78656-ca13-42c8-b45c-e0c1526c1fee', 'attached_at': '', 'detached_at': '', 'volume_id': '9f55b694-5668-468b-87db-dd20af9c0eee', 'serial'} {{(pid=74638) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 20:11:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] swap_volume: removing Cinder connection for volume de3f1df7-03b4-46f8-b7fe-77402aa88e05 {{(pid=74638) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 20:11:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] swap_volume: Updating volume de3f1df7-03b4-46f8-b7fe-77402aa88e05 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "yuOTNZCB", "auth_password": "P3WfLXSANqGDE8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "9f55b694-5668-468b-87db-dd20af9c0eee"}, "status": "reserved", "instance": "24b78656-ca13-42c8-b45c-e0c1526c1fee", "attached_at": "", "detached_at": "", "volume_id": "9f55b694-5668-468b-87db-dd20af9c0eee", "serial": "9f55b694-5668-468b-87db-dd20af9c0eee"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9f55b694-5668-468b-87db-dd20af9c0eee', 'no_device': None, 'attachment_id': '92b43cf9-7831-4434-8326-511587d994a6'} {{(pid=74638) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 20:11:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-63526408-8e34-45a3-9aa0-0823e9c51f0b tempest-TestVolumeSwap-673970437 tempest-TestVolumeSwap-673970437-project-admin] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 58.353s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:20 user nova-compute[74638]: INFO nova.compute.manager [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Detaching volume 9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:11:20 user nova-compute[74638]: INFO nova.virt.block_device [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Attempting to driver detach volume 9f55b694-5668-468b-87db-dd20af9c0eee from mountpoint /dev/vdb
Nov 08 20:11:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Attempting to detach device vdb from instance 24b78656-ca13-42c8-b45c-e0c1526c1fee from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:11:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:11:20 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:11:20 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:11:20 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:11:20 user nova-compute[74638]:   <serial>9f55b694-5668-468b-87db-dd20af9c0eee</serial>
Nov 08 20:11:20 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:11:20 user nova-compute[74638]: </disk>
Nov 08 20:11:20 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:11:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Successfully detached device vdb from instance 24b78656-ca13-42c8-b45c-e0c1526c1fee from the persistent domain config.
Nov 08 20:11:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24b78656-ca13-42c8-b45c-e0c1526c1fee from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:11:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:11:20 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:11:20 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:11:20 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:11:20 user nova-compute[74638]:   <serial>9f55b694-5668-468b-87db-dd20af9c0eee</serial>
Nov 08 20:11:20 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:11:20 user nova-compute[74638]: </disk>
Nov 08 20:11:20 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:11:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:11:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.objects.instance [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquired lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.network.neutron [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.objects.instance [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'info_cache' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.objects.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.network.neutron [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating instance_info_cache with network_info: [{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Releasing lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:11:28 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance destroyed successfully.
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.objects.instance [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'resources' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.objects.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_vif [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dae479f-02, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3f9cf40-b195-4bd5-9377-9dde2de1447c) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:28 user nova-compute[74638]: INFO os_vif [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02')
Nov 08 20:11:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXuNcYHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:11:28 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf893c0-743d-4217-9abb-206cf3bd3fe4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:11:28 user nova-compute[74638]: No targets found.
Nov 08 20:11:28 user nova-compute[74638]: iSNS:
Nov 08 20:11:28 user nova-compute[74638]: No targets found.
Nov 08 20:11:28 user nova-compute[74638]: STATIC:
Nov 08 20:11:28 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:11:28 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:28 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:28 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9
Nov 08 20:11:28 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:28 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:28 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf
Nov 08 20:11:28 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:28 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:28 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1
Nov 08 20:11:28 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:28 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:28 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:11:28 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:28 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:28 user nova-compute[74638]: FIRMWARE:
Nov 08 20:11:28 user nova-compute[74638]: No targets found.
Nov 08 20:11:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:11:28 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:11:28 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b6873-9f88-40c7-9854-0376724c277c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[381978d5-8cb7-4cd8-9e0d-5589bb83f05e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:28 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:28 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:28 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:28 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:28 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:28 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:28 user nova-compute[74638]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:28 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c380550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6796418a-35ef-4b23-ad80-502c42fce946]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[45df0ede-a449-42b9-a6be-f7d8466935fa]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7505ec8-ea2f-4b40-b162-f1028bcb4d9c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:11:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3364b32-46a3-4170-8671-4c6aee5248c5]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc35661e-58fb-46d9-b2be-58b3e73288fc]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e80c992-c084-45e2-9ec8-cd5221df0747]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260]
Nov 08 20:11:29 user nova-compute[74638]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260] successful.
Nov 08 20:11:29 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[718606da-b329-4652-93cf-6aee57ecf263]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== disconnect_volume: return (302ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Start _get_guest_xml network_info=[{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '457d5262-9e9d-441e-ac36-0a2846c6102a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXuNcYHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f91c46b4-8ab6-4480-80e0-5e6df682e609', 'attached_at': '', 'detached_at': '', 'volume_id': '22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 'serial': '22b1bf19-c5b4-4f16-8acc-a26cc4177a92'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.objects.instance [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'numa_topology' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.objects.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:11:29 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:11:29 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.objects.instance [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'vcpu_model' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.objects.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXuNcYHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:11:29 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:11:29 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:11:29 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd97d69-9d82-4dc9-8508-e3ce7d8b097a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:11:29 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b42713-62a3-4685-8536-3ae822829e90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92] added
Nov 08 20:11:29 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc21aa2e-87a3-463b-85d2-170e8e7c697a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1d8464-644c-42c5-a2de-f0897ff5dade]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXuNcYHs {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXuNcYHs" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e33c8-39a2-4106-a535-6a87a40281a7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FXuNcYHs'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4232f3-5919-4eab-b1ee-9b0e709ad159]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedb8c39-deb2-4ac0-a88a-1607ca59569a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:29 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:29 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff018e-53e7-4e1e-9775-223cd6201769]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260]
Nov 08 20:11:29 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260] successful.
Nov 08 20:11:29 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[243e832f-99fd-49c7-92c9-2048cb85a3f7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f3f47c-f3ac-427b-90c5-14107dd26240]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:29 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:29 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:29 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c811ced-42ac-4c23-9c84-a003b68bd9c8]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXuNcYHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:11:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26531663538656461', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531663538656461', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG nova.objects.instance [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'pci_devices' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG nova.objects.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:11:30 user nova-compute[74638]:   <uuid>f91c46b4-8ab6-4480-80e0-5e6df682e609</uuid>
Nov 08 20:11:30 user nova-compute[74638]:   <name>instance-00000004</name>
Nov 08 20:11:30 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:11:30 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:11:30 user nova-compute[74638]:   <metadata>
Nov 08 20:11:30 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:11:30 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:11:30 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeTestJSON-server-1261014533</nova:name>
Nov 08 20:11:30 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:11:29</nova:creationTime>
Nov 08 20:11:30 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:11:30 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:11:30 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:11:30 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:11:30 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:11:30 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:11:30 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:11:30 user nova-compute[74638]:       <nova:owner>
Nov 08 20:11:30 user nova-compute[74638]:         <nova:user uuid="b75bc3e9142b4bf6a314dc12b7a42bbe">tempest-AttachVolumeTestJSON-1773867302-project-member</nova:user>
Nov 08 20:11:30 user nova-compute[74638]:         <nova:project uuid="3b6b297f1c394c5d84966b543d7a9cc6">tempest-AttachVolumeTestJSON-1773867302</nova:project>
Nov 08 20:11:30 user nova-compute[74638]:       </nova:owner>
Nov 08 20:11:30 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:11:30 user nova-compute[74638]:       <nova:ports>
Nov 08 20:11:30 user nova-compute[74638]:         <nova:port uuid="2dae479f-02ee-40bc-8a5d-436e3931e032">
Nov 08 20:11:30 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 20:11:30 user nova-compute[74638]:         </nova:port>
Nov 08 20:11:30 user nova-compute[74638]:       </nova:ports>
Nov 08 20:11:30 user nova-compute[74638]:     </nova:instance>
Nov 08 20:11:30 user nova-compute[74638]:   </metadata>
Nov 08 20:11:30 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:11:30 user nova-compute[74638]:     <system>
Nov 08 20:11:30 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:11:30 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:11:30 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:11:30 user nova-compute[74638]:       <entry name="serial">f91c46b4-8ab6-4480-80e0-5e6df682e609</entry>
Nov 08 20:11:30 user nova-compute[74638]:       <entry name="uuid">f91c46b4-8ab6-4480-80e0-5e6df682e609</entry>
Nov 08 20:11:30 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:11:30 user nova-compute[74638]:     </system>
Nov 08 20:11:30 user nova-compute[74638]:   </sysinfo>
Nov 08 20:11:30 user nova-compute[74638]:   <os>
Nov 08 20:11:30 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:11:30 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:11:30 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:11:30 user nova-compute[74638]:   </os>
Nov 08 20:11:30 user nova-compute[74638]:   <features>
Nov 08 20:11:30 user nova-compute[74638]:     <acpi/>
Nov 08 20:11:30 user nova-compute[74638]:     <apic/>
Nov 08 20:11:30 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:11:30 user nova-compute[74638]:   </features>
Nov 08 20:11:30 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:11:30 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:11:30 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:11:30 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:11:30 user nova-compute[74638]:   </clock>
Nov 08 20:11:30 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:11:30 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:11:30 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:11:30 user nova-compute[74638]:   </cpu>
Nov 08 20:11:30 user nova-compute[74638]:   <devices>
Nov 08 20:11:30 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:11:30 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:11:30 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk"/>
Nov 08 20:11:30 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:11:30 user nova-compute[74638]:     </disk>
Nov 08 20:11:30 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:11:30 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:11:30 user nova-compute[74638]:       <source dev="/dev/sdb"/>
Nov 08 20:11:30 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:11:30 user nova-compute[74638]:       <serial>22b1bf19-c5b4-4f16-8acc-a26cc4177a92</serial>
Nov 08 20:11:30 user nova-compute[74638]:     </disk>
Nov 08 20:11:30 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:11:30 user nova-compute[74638]:       <mac address="fa:16:3e:32:99:5e"/>
Nov 08 20:11:30 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:11:30 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:11:30 user nova-compute[74638]:       <target dev="tap2dae479f-02"/>
Nov 08 20:11:30 user nova-compute[74638]:     </interface>
Nov 08 20:11:30 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:11:30 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/console.log" append="off"/>
Nov 08 20:11:30 user nova-compute[74638]:     </serial>
Nov 08 20:11:30 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:11:30 user nova-compute[74638]:     <video>
Nov 08 20:11:30 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:11:30 user nova-compute[74638]:     </video>
Nov 08 20:11:30 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:11:30 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:11:30 user nova-compute[74638]:     </rng>
Nov 08 20:11:30 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:11:30 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:11:30 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:11:30 user nova-compute[74638]:     </memballoon>
Nov 08 20:11:30 user nova-compute[74638]:   </devices>
Nov 08 20:11:30 user nova-compute[74638]: </domain>
Nov 08 20:11:30 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.objects.instance [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'trusted_certs' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.objects.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Cannot resize image /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.objects.instance [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'migration_context' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.objects.base [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG os_vif [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab8e4e0d-31a7-57ab-ac3a-c74f60ba0660', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dae479f-02, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dae479f-02, col_values=(('qos', UUID('26f98926-15b8-4eb8-842f-d79cfb426d1a')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dae479f-02, col_values=(('external_ids', {'iface-id': '2dae479f-02ee-40bc-8a5d-436e3931e032', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:99:5e', 'vm-uuid': 'f91c46b4-8ab6-4480-80e0-5e6df682e609'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:31 user nova-compute[74638]: INFO os_vif [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02')
Nov 08 20:11:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-b087ad67-0dd7-404d-b101-0f9f8acdddd5 req-5637f7cd-eb28-4efe-96a8-4395bececc48 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b087ad67-0dd7-404d-b101-0f9f8acdddd5 req-5637f7cd-eb28-4efe-96a8-4395bececc48 service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b087ad67-0dd7-404d-b101-0f9f8acdddd5 req-5637f7cd-eb28-4efe-96a8-4395bececc48 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b087ad67-0dd7-404d-b101-0f9f8acdddd5 req-5637f7cd-eb28-4efe-96a8-4395bececc48 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-b087ad67-0dd7-404d-b101-0f9f8acdddd5 req-5637f7cd-eb28-4efe-96a8-4395bececc48 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:11:33 user nova-compute[74638]: WARNING nova.compute.manager [req-b087ad67-0dd7-404d-b101-0f9f8acdddd5 req-5637f7cd-eb28-4efe-96a8-4395bececc48 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state stopped and task_state powering-on.
Nov 08 20:11:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:11:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-d7273324-c8d6-4b4b-9d2b-e3b2c83b45a8 req-6eff0ae5-982e-4bdb-9774-776694a0519b service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7273324-c8d6-4b4b-9d2b-e3b2c83b45a8 req-6eff0ae5-982e-4bdb-9774-776694a0519b service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7273324-c8d6-4b4b-9d2b-e3b2c83b45a8 req-6eff0ae5-982e-4bdb-9774-776694a0519b service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7273324-c8d6-4b4b-9d2b-e3b2c83b45a8 req-6eff0ae5-982e-4bdb-9774-776694a0519b service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-d7273324-c8d6-4b4b-9d2b-e3b2c83b45a8 req-6eff0ae5-982e-4bdb-9774-776694a0519b service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:11:35 user nova-compute[74638]: WARNING nova.compute.manager [req-d7273324-c8d6-4b4b-9d2b-e3b2c83b45a8 req-6eff0ae5-982e-4bdb-9774-776694a0519b service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state stopped and task_state powering-on.
Nov 08 20:11:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance rebooted successfully.
Nov 08 20:11:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-413c33b1-a177-403f-aca8-9a190abc5eba tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:11:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:41 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24b78656-ca13-42c8-b45c-e0c1526c1fee is timed out.
Nov 08 20:11:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Successfully detached device vdb from instance 24b78656-ca13-42c8-b45c-e0c1526c1fee from the live domain config.
Nov 08 20:11:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yuOTNZCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '9f55b694-5668-468b-87db-dd20af9c0eee'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:11:41 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb74cc-7968-48b3-b899-c13b3b9b3476]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:11:41 user nova-compute[74638]: No targets found.
Nov 08 20:11:41 user nova-compute[74638]: iSNS:
Nov 08 20:11:41 user nova-compute[74638]: No targets found.
Nov 08 20:11:41 user nova-compute[74638]: STATIC:
Nov 08 20:11:41 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee
Nov 08 20:11:41 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:41 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:41 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9
Nov 08 20:11:41 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:41 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:41 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf
Nov 08 20:11:41 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:41 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:41 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1
Nov 08 20:11:41 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:41 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:41 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:11:41 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:11:41 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:11:41 user nova-compute[74638]: FIRMWARE:
Nov 08 20:11:41 user nova-compute[74638]: No targets found.
Nov 08 20:11:41 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:11:41 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:11:41 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c86f6e-a487-488e-9111-a062b966d0fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[87358587-9572-4faa-82b5-bc6f091b3e28]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:41 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:41 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:41 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:41 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:41 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:11:41 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:11:41 user nova-compute[74638]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee (non-flash)
Nov 08 20:11:41 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:11:41 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:11:41 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c354430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d0ed57-17f3-4fec-a48e-4c9ace45eba6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbed210-da58-442c-afa7-6cdbbe63cd06]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c056b25c-5b4b-4fee-9174-5d75ba062889]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8014de-4d87-416b-bd9c-78935146f6b8]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da2bbf1-d174-434a-866d-7fbbbd84b747]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1fcd1d-555a-4cc3-ab20-c7fc78d0712a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260]
Nov 08 20:11:41 user nova-compute[74638]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee, portal: 172.16.0.220,3260] successful.
Nov 08 20:11:41 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f55b694-5668-468b-87db-dd20af9c0eee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[726df474-9cfc-43e6-8a32-2f0206221f4e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] <== disconnect_volume: return (383ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:11:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:11:42 user nova-compute[74638]: INFO nova.compute.claims [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Claim successful on node user
Nov 08 20:11:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:11:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:11:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:11:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG nova.policy [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16b8fcd95c5640fe844391a748962632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd043fa01edf445d7800d8769c42679b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:11:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Creating image(s)
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.239s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk 1073741824" returned: 0 in 0.053s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.218s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Successfully created port: d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:11:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:44 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Cannot resize image /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:11:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:11:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Ensure instance console log exists: /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:11:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Successfully updated port: d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquired lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-663802cc-04d4-4adb-af18-2ab9e79c0d8d req-635dfa22-d483-484f-89a6-d3e66242ae62 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-changed-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-663802cc-04d4-4adb-af18-2ab9e79c0d8d req-635dfa22-d483-484f-89a6-d3e66242ae62 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Refreshing instance network info cache due to event network-changed-36206fb4-fe9a-400f-90ff-cc2657e78bda. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-663802cc-04d4-4adb-af18-2ab9e79c0d8d req-635dfa22-d483-484f-89a6-d3e66242ae62 service nova] Acquiring lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-663802cc-04d4-4adb-af18-2ab9e79c0d8d req-635dfa22-d483-484f-89a6-d3e66242ae62 service nova] Acquired lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-663802cc-04d4-4adb-af18-2ab9e79c0d8d req-635dfa22-d483-484f-89a6-d3e66242ae62 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Refreshing network info cache for port 36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-769ed93e-3cce-48d7-8398-50bd660e4e85 req-4d9dc820-f6b6-4aa1-99f2-fc9f5747fcee service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-changed-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-769ed93e-3cce-48d7-8398-50bd660e4e85 req-4d9dc820-f6b6-4aa1-99f2-fc9f5747fcee service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Refreshing instance network info cache due to event network-changed-d614c985-f857-4c70-8c85-978502f3d371. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-769ed93e-3cce-48d7-8398-50bd660e4e85 req-4d9dc820-f6b6-4aa1-99f2-fc9f5747fcee service nova] Acquiring lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-663802cc-04d4-4adb-af18-2ab9e79c0d8d req-635dfa22-d483-484f-89a6-d3e66242ae62 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updated VIF entry in instance network info cache for port 36206fb4-fe9a-400f-90ff-cc2657e78bda. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-663802cc-04d4-4adb-af18-2ab9e79c0d8d req-635dfa22-d483-484f-89a6-d3e66242ae62 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updating instance_info_cache with network_info: [{"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-663802cc-04d4-4adb-af18-2ab9e79c0d8d req-635dfa22-d483-484f-89a6-d3e66242ae62 service nova] Releasing lock "refresh_cache-a8f5663b-ac6f-4037-96c8-94152295e07e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lazy-loading 'flavor' on Instance uuid 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Releasing lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance network_info: |[{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-769ed93e-3cce-48d7-8398-50bd660e4e85 req-4d9dc820-f6b6-4aa1-99f2-fc9f5747fcee service nova] Acquired lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:11:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-769ed93e-3cce-48d7-8398-50bd660e4e85 req-4d9dc820-f6b6-4aa1-99f2-fc9f5747fcee service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Refreshing network info cache for port d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Start _get_guest_xml network_info=[{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0ed6c03-2683-4318-9e17-8319b8447f85 tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.333s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'flavor' on Instance uuid a8f5663b-ac6f-4037-96c8-94152295e07e {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:46 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:11:46 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1737635490',display_name='tempest-ServerStableDeviceRescueTest-server-1737635490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1737635490',id=14,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv4BzGaDlMkGHGGrY4jSpEJ98U9jM3DTJwijs+luNH2DEebNfGrXkT4dqtpf/34BQk/mDcg+JeXTkYG/MiMXBYflJK97osFRYFp77MZm/WNRrQ9XpFvvMRDzoYfdjmvHA==',key_name='tempest-keypair-1947903140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d043fa01edf445d7800d8769c42679b0',ramdisk_id='',reservation_id='r-i7fdsk39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1632952037',owner_user_name='tempest-ServerStableDeviceRescueTest-1632952037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b8fcd95c5640fe844391a748962632',uuid=1953f44c-b839-4515-a0b4-1212bfa93092,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Converting VIF {"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=d614c985-f857-4c70-8c85-978502f3d371,network=Network(dcda2602-3545-4300-b633-881db1a6c3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd614c985-f8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'pci_devices' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:11:46 user nova-compute[74638]:   <uuid>1953f44c-b839-4515-a0b4-1212bfa93092</uuid>
Nov 08 20:11:46 user nova-compute[74638]:   <name>instance-0000000e</name>
Nov 08 20:11:46 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:11:46 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:11:46 user nova-compute[74638]:   <metadata>
Nov 08 20:11:46 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:11:46 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:11:46 user nova-compute[74638]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1737635490</nova:name>
Nov 08 20:11:46 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:11:46</nova:creationTime>
Nov 08 20:11:46 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:11:46 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:11:46 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:11:46 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:11:46 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:11:46 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:11:46 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:11:46 user nova-compute[74638]:       <nova:owner>
Nov 08 20:11:46 user nova-compute[74638]:         <nova:user uuid="16b8fcd95c5640fe844391a748962632">tempest-ServerStableDeviceRescueTest-1632952037-project-member</nova:user>
Nov 08 20:11:46 user nova-compute[74638]:         <nova:project uuid="d043fa01edf445d7800d8769c42679b0">tempest-ServerStableDeviceRescueTest-1632952037</nova:project>
Nov 08 20:11:46 user nova-compute[74638]:       </nova:owner>
Nov 08 20:11:46 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:11:46 user nova-compute[74638]:       <nova:ports>
Nov 08 20:11:46 user nova-compute[74638]:         <nova:port uuid="d614c985-f857-4c70-8c85-978502f3d371">
Nov 08 20:11:46 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 20:11:46 user nova-compute[74638]:         </nova:port>
Nov 08 20:11:46 user nova-compute[74638]:       </nova:ports>
Nov 08 20:11:46 user nova-compute[74638]:     </nova:instance>
Nov 08 20:11:46 user nova-compute[74638]:   </metadata>
Nov 08 20:11:46 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:11:46 user nova-compute[74638]:     <system>
Nov 08 20:11:46 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:11:46 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:11:46 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:11:46 user nova-compute[74638]:       <entry name="serial">1953f44c-b839-4515-a0b4-1212bfa93092</entry>
Nov 08 20:11:46 user nova-compute[74638]:       <entry name="uuid">1953f44c-b839-4515-a0b4-1212bfa93092</entry>
Nov 08 20:11:46 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:11:46 user nova-compute[74638]:     </system>
Nov 08 20:11:46 user nova-compute[74638]:   </sysinfo>
Nov 08 20:11:46 user nova-compute[74638]:   <os>
Nov 08 20:11:46 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:11:46 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:11:46 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:11:46 user nova-compute[74638]:   </os>
Nov 08 20:11:46 user nova-compute[74638]:   <features>
Nov 08 20:11:46 user nova-compute[74638]:     <acpi/>
Nov 08 20:11:46 user nova-compute[74638]:     <apic/>
Nov 08 20:11:46 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:11:46 user nova-compute[74638]:   </features>
Nov 08 20:11:46 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:11:46 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:11:46 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:11:46 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:11:46 user nova-compute[74638]:   </clock>
Nov 08 20:11:46 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:11:46 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:11:46 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:11:46 user nova-compute[74638]:   </cpu>
Nov 08 20:11:46 user nova-compute[74638]:   <devices>
Nov 08 20:11:46 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:11:46 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:11:46 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk"/>
Nov 08 20:11:46 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:11:46 user nova-compute[74638]:     </disk>
Nov 08 20:11:46 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:11:46 user nova-compute[74638]:       <mac address="fa:16:3e:f3:99:b0"/>
Nov 08 20:11:46 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:11:46 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:11:46 user nova-compute[74638]:       <target dev="tapd614c985-f8"/>
Nov 08 20:11:46 user nova-compute[74638]:     </interface>
Nov 08 20:11:46 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:11:46 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/console.log" append="off"/>
Nov 08 20:11:46 user nova-compute[74638]:     </serial>
Nov 08 20:11:46 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:11:46 user nova-compute[74638]:     <video>
Nov 08 20:11:46 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:11:46 user nova-compute[74638]:     </video>
Nov 08 20:11:46 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:11:46 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:11:46 user nova-compute[74638]:     </rng>
Nov 08 20:11:46 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:11:46 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:11:46 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:11:46 user nova-compute[74638]:     </memballoon>
Nov 08 20:11:46 user nova-compute[74638]:   </devices>
Nov 08 20:11:46 user nova-compute[74638]: </domain>
Nov 08 20:11:46 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1737635490',display_name='tempest-ServerStableDeviceRescueTest-server-1737635490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1737635490',id=14,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv4BzGaDlMkGHGGrY4jSpEJ98U9jM3DTJwijs+luNH2DEebNfGrXkT4dqtpf/34BQk/mDcg+JeXTkYG/MiMXBYflJK97osFRYFp77MZm/WNRrQ9XpFvvMRDzoYfdjmvHA==',key_name='tempest-keypair-1947903140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d043fa01edf445d7800d8769c42679b0',ramdisk_id='',reservation_id='r-i7fdsk39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1632952037',owner_user_name='tempest-ServerStableDeviceRescueTest-1632952037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b8fcd95c5640fe844391a748962632',uuid=1953f44c-b839-4515-a0b4-1212bfa93092,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Converting VIF {"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=d614c985-f857-4c70-8c85-978502f3d371,network=Network(dcda2602-3545-4300-b633-881db1a6c3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd614c985-f8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG os_vif [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=d614c985-f857-4c70-8c85-978502f3d371,network=Network(dcda2602-3545-4300-b633-881db1a6c3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd614c985-f8') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44ede80d-0242-56d0-b26e-8fd71d86dca8', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.131s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd614c985-f8, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd614c985-f8, col_values=(('qos', UUID('b8f79f60-06b4-4a43-bc5e-2ecb1a32fd14')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd614c985-f8, col_values=(('external_ids', {'iface-id': 'd614c985-f857-4c70-8c85-978502f3d371', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:99:b0', 'vm-uuid': '1953f44c-b839-4515-a0b4-1212bfa93092'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:46 user nova-compute[74638]: INFO os_vif [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=d614c985-f857-4c70-8c85-978502f3d371,network=Network(dcda2602-3545-4300-b633-881db1a6c3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd614c985-f8')
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No VIF found with MAC fa:16:3e:f3:99:b0, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:46 user nova-compute[74638]: INFO nova.compute.manager [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Attaching volume 879763b7-beb0-41a3-93e2-0f8b3388f126 to /dev/vdb
Nov 08 20:11:46 user nova-compute[74638]: DEBUG os_brick.utils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912f1f0-0b92-4005-8788-0c8694939470]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce56c6-94d1-46e1-84ce-21c7d167f480]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2150f99-e911-47e0-a72f-a4bc51be7eef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a93aaa-b4d2-4627-ac4b-17178db0f010]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:11:46 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:11:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a63439-854f-4969-b0d1-9bad661225d9]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG os_brick.utils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:11:46 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updating existing volume attachment record: be10fa7f-d832-44b0-96b7-bba0a55d73d4 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:11:47 user nova-compute[74638]: DEBUG nova.network.neutron [req-769ed93e-3cce-48d7-8398-50bd660e4e85 req-4d9dc820-f6b6-4aa1-99f2-fc9f5747fcee service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updated VIF entry in instance network info cache for port d614c985-f857-4c70-8c85-978502f3d371. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:11:47 user nova-compute[74638]: DEBUG nova.network.neutron [req-769ed93e-3cce-48d7-8398-50bd660e4e85 req-4d9dc820-f6b6-4aa1-99f2-fc9f5747fcee service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:11:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-769ed93e-3cce-48d7-8398-50bd660e4e85 req-4d9dc820-f6b6-4aa1-99f2-fc9f5747fcee service nova] Releasing lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:11:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-e5f5fa64-83af-483d-9534-2d8ec0f1d22d req-d0d47c4b-b0cb-469d-b71a-de48e3dd4d2d service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5f5fa64-83af-483d-9534-2d8ec0f1d22d req-d0d47c4b-b0cb-469d-b71a-de48e3dd4d2d service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5f5fa64-83af-483d-9534-2d8ec0f1d22d req-d0d47c4b-b0cb-469d-b71a-de48e3dd4d2d service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5f5fa64-83af-483d-9534-2d8ec0f1d22d req-d0d47c4b-b0cb-469d-b71a-de48e3dd4d2d service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-e5f5fa64-83af-483d-9534-2d8ec0f1d22d req-d0d47c4b-b0cb-469d-b71a-de48e3dd4d2d service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:11:48 user nova-compute[74638]: WARNING nova.compute.manager [req-e5f5fa64-83af-483d-9534-2d8ec0f1d22d req-d0d47c4b-b0cb-469d-b71a-de48e3dd4d2d service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state building and task_state spawning.
Nov 08 20:11:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-fd2dbf6f-45e2-44ff-8caf-2e9bf7a3b6bb req-2a054bfe-77a4-40a3-b965-ba7f1a758f8c service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd2dbf6f-45e2-44ff-8caf-2e9bf7a3b6bb req-2a054bfe-77a4-40a3-b965-ba7f1a758f8c service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd2dbf6f-45e2-44ff-8caf-2e9bf7a3b6bb req-2a054bfe-77a4-40a3-b965-ba7f1a758f8c service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd2dbf6f-45e2-44ff-8caf-2e9bf7a3b6bb req-2a054bfe-77a4-40a3-b965-ba7f1a758f8c service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-fd2dbf6f-45e2-44ff-8caf-2e9bf7a3b6bb req-2a054bfe-77a4-40a3-b965-ba7f1a758f8c service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:11:50 user nova-compute[74638]: WARNING nova.compute.manager [req-fd2dbf6f-45e2-44ff-8caf-2e9bf7a3b6bb req-2a054bfe-77a4-40a3-b965-ba7f1a758f8c service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state building and task_state spawning.
Nov 08 20:11:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance spawned successfully.
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:11:50 user nova-compute[74638]: INFO nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Took 7.62 seconds to spawn the instance on the hypervisor.
Nov 08 20:11:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:11:50 user nova-compute[74638]: INFO nova.compute.manager [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Took 8.39 seconds to build instance.
Nov 08 20:11:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e44fda23-52e5-4e2a-959f-f0c4e1174fab tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.541s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:52 user nova-compute[74638]: INFO nova.compute.manager [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Terminating instance
Nov 08 20:11:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-c55f1ad8-3364-432e-b5c9-0ba3af0418ac req-9c93ad72-642e-48ed-be64-7d727eddbe25 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received event network-vif-unplugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c55f1ad8-3364-432e-b5c9-0ba3af0418ac req-9c93ad72-642e-48ed-be64-7d727eddbe25 service nova] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c55f1ad8-3364-432e-b5c9-0ba3af0418ac req-9c93ad72-642e-48ed-be64-7d727eddbe25 service nova] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c55f1ad8-3364-432e-b5c9-0ba3af0418ac req-9c93ad72-642e-48ed-be64-7d727eddbe25 service nova] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-c55f1ad8-3364-432e-b5c9-0ba3af0418ac req-9c93ad72-642e-48ed-be64-7d727eddbe25 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] No waiting events found dispatching network-vif-unplugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-c55f1ad8-3364-432e-b5c9-0ba3af0418ac req-9c93ad72-642e-48ed-be64-7d727eddbe25 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received event network-vif-unplugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:53 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Instance destroyed successfully.
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.objects.instance [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lazy-loading 'resources' on Instance uuid 204d636f-c342-45df-a083-7aa388a62c54 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1882246038',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1882246038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1882246',id=12,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0Vgi9ZgDsItlNC7CEk8h8/kSOGciWmeh0bLWM8ezpa+JfKiEA7F8Ki0d4GJGrUt5Q04ro69vOKtsZYCoKtP2oR9Nf61zTfdstNTH24PTSAwNK4pO67+RS9Ufw1QYxE6g==',key_name='tempest-keypair-1191401701',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:08:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06319d69a1c543989c144da2071557ab',ramdisk_id='',reservation_id='r-yi6rq6e7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-214754820',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22b2dc262b9843fe99418689a6511efc',uuid=204d636f-c342-45df-a083-7aa388a62c54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Converting VIF {"id": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "address": "fa:16:3e:6f:24:cf", "network": {"id": "11cc2465-90cf-4451-9c70-34a752a110f4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995106204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06319d69a1c543989c144da2071557ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57b2113f-dc", "ovs_interfaceid": "57b2113f-dc55-4a33-9bd0-965a4eae35dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:24:cf,bridge_name='br-int',has_traffic_filtering=True,id=57b2113f-dc55-4a33-9bd0-965a4eae35dd,network=Network(11cc2465-90cf-4451-9c70-34a752a110f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b2113f-dc') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG os_vif [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:24:cf,bridge_name='br-int',has_traffic_filtering=True,id=57b2113f-dc55-4a33-9bd0-965a4eae35dd,network=Network(11cc2465-90cf-4451-9c70-34a752a110f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b2113f-dc') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57b2113f-dc, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b3e2213-5ca5-44e9-ba6f-fd67aea233e0) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:53 user nova-compute[74638]: INFO os_vif [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:24:cf,bridge_name='br-int',has_traffic_filtering=True,id=57b2113f-dc55-4a33-9bd0-965a4eae35dd,network=Network(11cc2465-90cf-4451-9c70-34a752a110f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57b2113f-dc')
Nov 08 20:11:53 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Deleting instance files /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54_del
Nov 08 20:11:53 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Deletion of /opt/stack/data/nova/instances/204d636f-c342-45df-a083-7aa388a62c54_del complete
Nov 08 20:11:53 user nova-compute[74638]: INFO nova.compute.manager [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 08 20:11:53 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:11:53 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 204d636f-c342-45df-a083-7aa388a62c54] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:11:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:11:55 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Took 1.34 seconds to deallocate network for instance.
Nov 08 20:11:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-6adfe68d-4871-44d8-9448-f0d7d49afda7 req-5d6295f9-314e-4af1-81b4-85cb26c40bdd service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received event network-vif-deleted-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-ab0cde9e-96b5-4848-a4e3-3fa4fc1ee8c0 req-4ffc5c8a-96cc-474b-8aa5-65f367c686a2 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received event network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ab0cde9e-96b5-4848-a4e3-3fa4fc1ee8c0 req-4ffc5c8a-96cc-474b-8aa5-65f367c686a2 service nova] Acquiring lock "204d636f-c342-45df-a083-7aa388a62c54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ab0cde9e-96b5-4848-a4e3-3fa4fc1ee8c0 req-4ffc5c8a-96cc-474b-8aa5-65f367c686a2 service nova] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ab0cde9e-96b5-4848-a4e3-3fa4fc1ee8c0 req-4ffc5c8a-96cc-474b-8aa5-65f367c686a2 service nova] Lock "204d636f-c342-45df-a083-7aa388a62c54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-ab0cde9e-96b5-4848-a4e3-3fa4fc1ee8c0 req-4ffc5c8a-96cc-474b-8aa5-65f367c686a2 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] No waiting events found dispatching network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:11:55 user nova-compute[74638]: WARNING nova.compute.manager [req-ab0cde9e-96b5-4848-a4e3-3fa4fc1ee8c0 req-4ffc5c8a-96cc-474b-8aa5-65f367c686a2 service nova] [instance: 204d636f-c342-45df-a083-7aa388a62c54] Received unexpected event network-vif-plugged-57b2113f-dc55-4a33-9bd0-965a4eae35dd for instance with vm_state deleted and task_state None.
Nov 08 20:11:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:11:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.743s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:56 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Deleted allocations for instance 204d636f-c342-45df-a083-7aa388a62c54
Nov 08 20:11:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b76af168-d6cb-4bdb-99da-f385666c5ced tempest-TestServerVolumeAttachScenarioOldVersion-214754820 tempest-TestServerVolumeAttachScenarioOldVersion-214754820-project-member] Lock "204d636f-c342-45df-a083-7aa388a62c54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.383s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updating instance_info_cache with network_info: [{"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-24b78656-ca13-42c8-b45c-e0c1526c1fee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:11:57 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:11:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:11:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:11:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:11:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:01 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:12:01 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7860MB free_disk=25.68450164794922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 10037bd1-d710-4ce1-abe8-b1f5b657c828 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 24b78656-ca13-42c8-b45c-e0c1526c1fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a690cfa9-2a34-43a9-843b-e7548703a5e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a8f5663b-ac6f-4037-96c8-94152295e07e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 1953f44c-b839-4515-a0b4-1212bfa93092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:12:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.866s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Acquiring lock "466df7f1-8c73-4aa4-8d82-deb194a42782" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Lock "466df7f1-8c73-4aa4-8d82-deb194a42782" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:12:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:12:05 user nova-compute[74638]: INFO nova.compute.claims [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Claim successful on node user
Nov 08 20:12:06 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:12:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:12:06 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:12:06 user nova-compute[74638]: INFO nova.virt.block_device [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Booting with volume 4a4dff36-ba6e-4ebd-abc2-6496e28b51f1 at /dev/vda
Nov 08 20:12:06 user nova-compute[74638]: DEBUG nova.policy [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86f60b7a12b431ba675a336f8dfa064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee96fbc2bc244d7a997392d322544d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG os_brick.utils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e8a92-38e9-4655-a658-252c5839a63a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58eac5d-3f41-48ff-b3f2-471ec43e6741]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db61401-7e93-4ef9-8597-6af39f1812d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb36599-81f9-4f82-a3af-9ee9473ac6a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:12:06 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:12:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d2139a-4ba2-4c9c-aec4-e32cbdf0144f]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG os_brick.utils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:06 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Updating existing volume attachment record: 03d1e231-2fae-4792-ba76-62a777b4b07f {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:12:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Successfully created port: 49dde973-6c58-41d6-8571-48988dc3f5d9 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:12:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Successfully updated port: 49dde973-6c58-41d6-8571-48988dc3f5d9 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Acquiring lock "refresh_cache-466df7f1-8c73-4aa4-8d82-deb194a42782" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Acquired lock "refresh_cache-466df7f1-8c73-4aa4-8d82-deb194a42782" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-8ff358cf-3154-40b1-8311-9be68f0d8000 req-9c195ccc-8685-44df-903f-97ade03ebf3d service nova] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Received event network-changed-49dde973-6c58-41d6-8571-48988dc3f5d9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-8ff358cf-3154-40b1-8311-9be68f0d8000 req-9c195ccc-8685-44df-903f-97ade03ebf3d service nova] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Refreshing instance network info cache due to event network-changed-49dde973-6c58-41d6-8571-48988dc3f5d9. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ff358cf-3154-40b1-8311-9be68f0d8000 req-9c195ccc-8685-44df-903f-97ade03ebf3d service nova] Acquiring lock "refresh_cache-466df7f1-8c73-4aa4-8d82-deb194a42782" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:09 user nova-compute[74638]: WARNING nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 07aab635-2120-4d29-8e6b-40a725ed8f37 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 10037bd1-d710-4ce1-abe8-b1f5b657c828 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid a690cfa9-2a34-43a9-843b-e7548703a5e3 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid a8f5663b-ac6f-4037-96c8-94152295e07e {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 466df7f1-8c73-4aa4-8d82-deb194a42782 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "07aab635-2120-4d29-8e6b-40a725ed8f37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "466df7f1-8c73-4aa4-8d82-deb194a42782" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Updating instance_info_cache with network_info: [{"id": "49dde973-6c58-41d6-8571-48988dc3f5d9", "address": "fa:16:3e:d8:52:e1", "network": {"id": "12cdd1aa-a808-43d7-baa0-f8bb831c18f4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1375456694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee96fbc2bc244d7a997392d322544d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dde973-6c", "ovs_interfaceid": "49dde973-6c58-41d6-8571-48988dc3f5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Releasing lock "refresh_cache-466df7f1-8c73-4aa4-8d82-deb194a42782" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:12:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Instance network_info: |[{"id": "49dde973-6c58-41d6-8571-48988dc3f5d9", "address": "fa:16:3e:d8:52:e1", "network": {"id": "12cdd1aa-a808-43d7-baa0-f8bb831c18f4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1375456694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee96fbc2bc244d7a997392d322544d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dde973-6c", "ovs_interfaceid": "49dde973-6c58-41d6-8571-48988dc3f5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:12:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ff358cf-3154-40b1-8311-9be68f0d8000 req-9c195ccc-8685-44df-903f-97ade03ebf3d service nova] Acquired lock "refresh_cache-466df7f1-8c73-4aa4-8d82-deb194a42782" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:12:10 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ff358cf-3154-40b1-8311-9be68f0d8000 req-9c195ccc-8685-44df-903f-97ade03ebf3d service nova] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Refreshing network info cache for port 49dde973-6c58-41d6-8571-48988dc3f5d9 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:12:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ff358cf-3154-40b1-8311-9be68f0d8000 req-9c195ccc-8685-44df-903f-97ade03ebf3d service nova] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Updated VIF entry in instance network info cache for port 49dde973-6c58-41d6-8571-48988dc3f5d9. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ff358cf-3154-40b1-8311-9be68f0d8000 req-9c195ccc-8685-44df-903f-97ade03ebf3d service nova] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Updating instance_info_cache with network_info: [{"id": "49dde973-6c58-41d6-8571-48988dc3f5d9", "address": "fa:16:3e:d8:52:e1", "network": {"id": "12cdd1aa-a808-43d7-baa0-f8bb831c18f4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1375456694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee96fbc2bc244d7a997392d322544d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dde973-6c", "ovs_interfaceid": "49dde973-6c58-41d6-8571-48988dc3f5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ff358cf-3154-40b1-8311-9be68f0d8000 req-9c195ccc-8685-44df-903f-97ade03ebf3d service nova] Releasing lock "refresh_cache-466df7f1-8c73-4aa4-8d82-deb194a42782" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:11 user nova-compute[74638]: INFO nova.compute.manager [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Terminating instance
Nov 08 20:12:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:12 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Instance destroyed successfully.
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lazy-loading 'resources' on Instance uuid 24b78656-ca13-42c8-b45c-e0c1526c1fee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-829303057',display_name='tempest-TestVolumeSwap-server-829303057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-829303057',id=8,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc+XkTviaaoAEGe1ENFZkAW+oJRv3HgL2CV3sj1kAcXXqlPdWQTOa08CS1KxAvM6gutQ6w7FlXgok1d/Vnx8MFknNJnAfdXkAThHDP4I2T9o4dVO1OuLoS4VT03fLb35w==',key_name='tempest-keypair-1031493326',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f472295181a4bb88d49b2a73d2e60b3',ramdisk_id='',reservation_id='r-ncb65h8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-541036512',owner_user_name='tempest-TestVolumeSwap-541036512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f198734797a94f8ebda2f3cec7655c61',uuid=24b78656-ca13-42c8-b45c-e0c1526c1fee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Converting VIF {"id": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "address": "fa:16:3e:dc:97:0f", "network": {"id": "536d14af-a7b4-4197-82d0-568598cfe963", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1080751938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f472295181a4bb88d49b2a73d2e60b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4be2549-2c", "ovs_interfaceid": "e4be2549-2cdf-4d34-a56f-3ec27579c1c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=e4be2549-2cdf-4d34-a56f-3ec27579c1c1,network=Network(536d14af-a7b4-4197-82d0-568598cfe963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4be2549-2c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG os_vif [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=e4be2549-2cdf-4d34-a56f-3ec27579c1c1,network=Network(536d14af-a7b4-4197-82d0-568598cfe963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4be2549-2c') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4be2549-2c, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b64d13b3-6db7-464a-844c-74946514cfce) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:12 user nova-compute[74638]: INFO os_vif [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:97:0f,bridge_name='br-int',has_traffic_filtering=True,id=e4be2549-2cdf-4d34-a56f-3ec27579c1c1,network=Network(536d14af-a7b4-4197-82d0-568598cfe963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4be2549-2c')
Nov 08 20:12:12 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Deleting instance files /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee_del
Nov 08 20:12:12 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Deletion of /opt/stack/data/nova/instances/24b78656-ca13-42c8-b45c-e0c1526c1fee_del complete
Nov 08 20:12:12 user nova-compute[74638]: INFO nova.compute.manager [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 20:12:12 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:12 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Took 0.69 seconds to deallocate network for instance.
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.compute.manager [req-0a23535b-3bd6-48ca-99a2-b916bef8c443 req-0ecd00ae-ebd6-4892-a0ac-bf3db00693b4 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Received event network-vif-deleted-e4be2549-2cdf-4d34-a56f-3ec27579c1c1 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:12 user nova-compute[74638]: INFO nova.compute.manager [req-0a23535b-3bd6-48ca-99a2-b916bef8c443 req-0ecd00ae-ebd6-4892-a0ac-bf3db00693b4 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Neutron deleted interface e4be2549-2cdf-4d34-a56f-3ec27579c1c1; detaching it from the instance and deleting it from the info cache
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.network.neutron [req-0a23535b-3bd6-48ca-99a2-b916bef8c443 req-0ecd00ae-ebd6-4892-a0ac-bf3db00693b4 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG nova.compute.manager [req-0a23535b-3bd6-48ca-99a2-b916bef8c443 req-0ecd00ae-ebd6-4892-a0ac-bf3db00693b4 service nova] [instance: 24b78656-ca13-42c8-b45c-e0c1526c1fee] Detach interface failed, port_id=e4be2549-2cdf-4d34-a56f-3ec27579c1c1, reason: Instance 24b78656-ca13-42c8-b45c-e0c1526c1fee could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:13 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:12:13 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:12:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:13 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Deleted allocations for instance 24b78656-ca13-42c8-b45c-e0c1526c1fee
Nov 08 20:12:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-16f64151-68f2-465a-af7a-e547fa12ac9f req-79aff0b8-0aa7-44bb-b77e-9fb4ca549f89 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-changed-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-16f64151-68f2-465a-af7a-e547fa12ac9f req-79aff0b8-0aa7-44bb-b77e-9fb4ca549f89 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing instance network info cache due to event network-changed-39f6ae3f-3753-4366-9981-c55d3e1c5742. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:12:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-16f64151-68f2-465a-af7a-e547fa12ac9f req-79aff0b8-0aa7-44bb-b77e-9fb4ca549f89 service nova] Acquiring lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:12:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-16f64151-68f2-465a-af7a-e547fa12ac9f req-79aff0b8-0aa7-44bb-b77e-9fb4ca549f89 service nova] Acquired lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:12:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-16f64151-68f2-465a-af7a-e547fa12ac9f req-79aff0b8-0aa7-44bb-b77e-9fb4ca549f89 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Refreshing network info cache for port 39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:12:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8679cc9c-0a6a-4c2c-83a7-31db5bd39c9d tempest-TestVolumeSwap-541036512 tempest-TestVolumeSwap-541036512-project-member] Lock "24b78656-ca13-42c8-b45c-e0c1526c1fee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-16f64151-68f2-465a-af7a-e547fa12ac9f req-79aff0b8-0aa7-44bb-b77e-9fb4ca549f89 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updated VIF entry in instance network info cache for port 39f6ae3f-3753-4366-9981-c55d3e1c5742. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:12:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-16f64151-68f2-465a-af7a-e547fa12ac9f req-79aff0b8-0aa7-44bb-b77e-9fb4ca549f89 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [{"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-16f64151-68f2-465a-af7a-e547fa12ac9f req-79aff0b8-0aa7-44bb-b77e-9fb4ca549f89 service nova] Releasing lock "refresh_cache-a690cfa9-2a34-43a9-843b-e7548703a5e3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:16 user nova-compute[74638]: INFO nova.compute.manager [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Terminating instance
Nov 08 20:12:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-6c4536d3-9420-49ce-9e89-b8ff9ad6ca6a req-4cc7da5d-b198-4247-9a32-ca7b8d1c3c76 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6c4536d3-9420-49ce-9e89-b8ff9ad6ca6a req-4cc7da5d-b198-4247-9a32-ca7b8d1c3c76 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6c4536d3-9420-49ce-9e89-b8ff9ad6ca6a req-4cc7da5d-b198-4247-9a32-ca7b8d1c3c76 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6c4536d3-9420-49ce-9e89-b8ff9ad6ca6a req-4cc7da5d-b198-4247-9a32-ca7b8d1c3c76 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-6c4536d3-9420-49ce-9e89-b8ff9ad6ca6a req-4cc7da5d-b198-4247-9a32-ca7b8d1c3c76 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-unplugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-6c4536d3-9420-49ce-9e89-b8ff9ad6ca6a req-4cc7da5d-b198-4247-9a32-ca7b8d1c3c76 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-a3065bd2-784c-4a34-a84e-3c6ce22cc643 req-e583d7f3-db06-4d15-a724-f4cc8c65593e service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a3065bd2-784c-4a34-a84e-3c6ce22cc643 req-e583d7f3-db06-4d15-a724-f4cc8c65593e service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a3065bd2-784c-4a34-a84e-3c6ce22cc643 req-e583d7f3-db06-4d15-a724-f4cc8c65593e service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a3065bd2-784c-4a34-a84e-3c6ce22cc643 req-e583d7f3-db06-4d15-a724-f4cc8c65593e service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-a3065bd2-784c-4a34-a84e-3c6ce22cc643 req-e583d7f3-db06-4d15-a724-f4cc8c65593e service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-unplugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-a3065bd2-784c-4a34-a84e-3c6ce22cc643 req-e583d7f3-db06-4d15-a724-f4cc8c65593e service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:12:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOrkFjpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:17 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:17 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:17 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca77e5d7-6dc1-4909-800f-c18ffbc3edaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:12:17 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[66495343-5a5c-4aab-9e28-625ace4682b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126] added
Nov 08 20:12:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dcfe3f-abdf-4dee-8700-81c7a367705f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ba5334-66d2-444a-9999-1465f172e463]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TOrkFjpn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TOrkFjpn" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f0df89-78c9-4187-ab31-c03d2c6cc1bd]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TOrkFjpn'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0df76-78de-4a0f-981c-057f6170cd3c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea152b6-ee6a-4bea-9789-c7b1c030fd93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff473a5-fc7c-42dd-a4e3-944dfd512899]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260]
Nov 08 20:12:17 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260] successful.
Nov 08 20:12:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6982b438-d151-4428-b54f-21267fd120cf]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.070s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b889b8fb-a345-451f-a16e-581e2c7119db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:17 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc4884-f4b4-473a-b114-35c1364167ae]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:12:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOrkFjpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:12:18 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Instance destroyed successfully.
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.objects.instance [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lazy-loading 'resources' on Instance uuid a690cfa9-2a34-43a9-843b-e7548703a5e3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d0:13,bridge_name='br-int',has_traffic_filtering=True,id=39f6ae3f-3753-4366-9981-c55d3e1c5742,network=Network(ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ae3f-37') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d0:13,bridge_name='br-int',has_traffic_filtering=True,id=39f6ae3f-3753-4366-9981-c55d3e1c5742,network=Network(ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ae3f-37') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39f6ae3f-37, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7038a7b7-6f53-4a73-a2cd-8858a33e9188) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: INFO os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d0:13,bridge_name='br-int',has_traffic_filtering=True,id=39f6ae3f-3753-4366-9981-c55d3e1c5742,network=Network(ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39f6ae3f-37')
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:47:08,bridge_name='br-int',has_traffic_filtering=True,id=e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a3d17e-e8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:47:08,bridge_name='br-int',has_traffic_filtering=True,id=e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a3d17e-e8') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1a3d17e-e8, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8594892-1270-4f02-b96f-8f2e32d02943) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: INFO os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:47:08,bridge_name='br-int',has_traffic_filtering=True,id=e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape1a3d17e-e8')
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:85:2a,bridge_name='br-int',has_traffic_filtering=True,id=d2fdd908-4718-40b1-9b99-5ebf4604b9df,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2fdd908-47') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:85:2a,bridge_name='br-int',has_traffic_filtering=True,id=d2fdd908-4718-40b1-9b99-5ebf4604b9df,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2fdd908-47') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2fdd908-47, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=722e5e16-9420-4049-9341-18ed765d1759) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: INFO os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:85:2a,bridge_name='br-int',has_traffic_filtering=True,id=d2fdd908-4718-40b1-9b99-5ebf4604b9df,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2fdd908-47')
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:b3,bridge_name='br-int',has_traffic_filtering=True,id=14326ab0-0b69-421f-a8f2-415d96da78ae,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14326ab0-0b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:b3,bridge_name='br-int',has_traffic_filtering=True,id=14326ab0-0b69-421f-a8f2-415d96da78ae,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14326ab0-0b') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14326ab0-0b, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56b3f0a2-07c3-4f00-8158-8ee2e90b8f1f) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: INFO os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e5:b3,bridge_name='br-int',has_traffic_filtering=True,id=14326ab0-0b69-421f-a8f2-415d96da78ae,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14326ab0-0b')
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "address": "fa:16:3e:79:e6:1b", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31ed79ac-1c", "ovs_interfaceid": "31ed79ac-1c5f-4569-977b-afa85fec9d49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:e6:1b,bridge_name='br-int',has_traffic_filtering=True,id=31ed79ac-1c5f-4569-977b-afa85fec9d49,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ed79ac-1c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:e6:1b,bridge_name='br-int',has_traffic_filtering=True,id=31ed79ac-1c5f-4569-977b-afa85fec9d49,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ed79ac-1c') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31ed79ac-1c, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad7ad232-74b7-46d2-82d0-bda213b1e47d) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: INFO os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:e6:1b,bridge_name='br-int',has_traffic_filtering=True,id=31ed79ac-1c5f-4569-977b-afa85fec9d49,network=Network(e259c557-e727-4bad-a8a6-7b49e94a9ceb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31ed79ac-1c')
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:68,bridge_name='br-int',has_traffic_filtering=True,id=6a6b4dcd-90cb-4c1c-b2e4-f128d950e805,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b4dcd-90') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:68,bridge_name='br-int',has_traffic_filtering=True,id=6a6b4dcd-90cb-4c1c-b2e4-f128d950e805,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b4dcd-90') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a6b4dcd-90, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5405acc-4bf3-475d-9612-e05e14384ada) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: INFO os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:fa:68,bridge_name='br-int',has_traffic_filtering=True,id=6a6b4dcd-90cb-4c1c-b2e4-f128d950e805,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6b4dcd-90')
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2074346570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2074346570',id=10,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEehIpK8pJ165Nl2D52mWxr5CEY4fSUtnY9fxsb29Z2tsWFlgx2HRhOSiCd2L5ZkXeRvgL4oZkyrcAIr1xCTNYLtborOi0z7CiadUrztdVXCpKkqDsQg+RQz9fMVaHRQQ==',key_name='tempest-keypair-952415364',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33f19fa23d934a7ea5ffb026c605c8d9',ramdisk_id='',reservation_id='r-7owfhswk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1750493064',owner_user_name='tempest-TaggedBootDevicesTest-1750493064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7f6cb5c4b445bab1b501bc8aff5523',uuid=a690cfa9-2a34-43a9-843b-e7548703a5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converting VIF {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:d8,bridge_name='br-int',has_traffic_filtering=True,id=dda4bb7c-991c-4ed3-893f-1db9ef50c161,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda4bb7c-99') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:d8,bridge_name='br-int',has_traffic_filtering=True,id=dda4bb7c-991c-4ed3-893f-1db9ef50c161,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda4bb7c-99') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdda4bb7c-99, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=113b946d-2b00-4f08-a4dc-71aa65c3be1f) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:18 user nova-compute[74638]: INFO os_vif [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:98:d8,bridge_name='br-int',has_traffic_filtering=True,id=dda4bb7c-991c-4ed3-893f-1db9ef50c161,network=Network(ef8cb62f-d72a-448d-8c9e-d1a835f9fe72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda4bb7c-99')
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrpAdvqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:18 user nova-compute[74638]: WARNING nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-39f6ae3f-3753-4366-9981-c55d3e1c5742 for instance with vm_state active and task_state deleting.
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-unplugged-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-14326ab0-0b69-421f-a8f2-415d96da78ae for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:18 user nova-compute[74638]: WARNING nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-14326ab0-0b69-421f-a8f2-415d96da78ae for instance with vm_state active and task_state deleting.
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-unplugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:18 user nova-compute[74638]: WARNING nova.compute.manager [req-b18405e3-aef6-4c11-8645-608df91bb9b3 req-fd516655-204f-43d7-86e3-0cfb7b757314 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-dda4bb7c-991c-4ed3-893f-1db9ef50c161 for instance with vm_state active and task_state deleting.
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== connect_volume: return (1500ms) {'type': 'block', 'scsi_wwn': '26265666436653538', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265666436653538', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.190s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.objects.instance [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'flavor' on Instance uuid a8f5663b-ac6f-4037-96c8-94152295e07e {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2148275d-155a-4626-b63c-5a85d7684eeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:12:18 user nova-compute[74638]: No targets found.
Nov 08 20:12:18 user nova-compute[74638]: iSNS:
Nov 08 20:12:18 user nova-compute[74638]: No targets found.
Nov 08 20:12:18 user nova-compute[74638]: STATIC:
Nov 08 20:12:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:12:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9
Nov 08 20:12:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf
Nov 08 20:12:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1
Nov 08 20:12:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:18 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:12:18 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:18 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:18 user nova-compute[74638]: FIRMWARE:
Nov 08 20:12:18 user nova-compute[74638]: No targets found.
Nov 08 20:12:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:12:18 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:12:18 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:12:18 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:12:18 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:12:18 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:12:18 user nova-compute[74638]:   <serial>879763b7-beb0-41a3-93e2-0f8b3388f126</serial>
Nov 08 20:12:18 user nova-compute[74638]: </disk>
Nov 08 20:12:18 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f63641-62c5-47b9-9ddf-06017c35bf05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a24c9f5-42a2-4ee9-b483-fc7ad1b9b976]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3ee950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1'): ({'sdg'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Removing single pathed devices sdg {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:19 user nova-compute[74638]: WARNING nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c for instance with vm_state active and task_state deleting.
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-unplugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:19 user nova-compute[74638]: WARNING nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-d2fdd908-4718-40b1-9b99-5ebf4604b9df for instance with vm_state active and task_state deleting.
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-unplugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9fc6d4d-0463-486d-8e76-f7df0b7b923f req-7a8089f0-7d5f-45a4-b669-abb92cef8f7f service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a77b02-079f-4ab6-a770-232f204201b1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0390f619-af1d-4f43-ba65-1d717197cae2]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Flushing IO for device /dev/sdg {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbcce8a-ba8a-4812-9cd8-cf5da29ec637]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.069s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6716a1ab-2f8f-4a2d-b1cc-dffa2dcd837d]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] SCSI volumes sdg have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1e0ce-32ea-452e-b722-c020f267c925]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcf8b31-36f1-4624-b6be-13150d249b70]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1, portal: 172.16.0.220,3260]
Nov 08 20:12:19 user nova-compute[74638]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1, portal: 172.16.0.220,3260] successful.
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ca0a9e4-603e-406f-876a-dadeca621ab1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[82903429-40de-4b3b-8ec4-1622efafafef]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== disconnect_volume: return (583ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mxkJfDHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:19 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdd7223-5011-4571-9265-17bcb9506e3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:12:19 user nova-compute[74638]: No targets found.
Nov 08 20:12:19 user nova-compute[74638]: iSNS:
Nov 08 20:12:19 user nova-compute[74638]: No targets found.
Nov 08 20:12:19 user nova-compute[74638]: STATIC:
Nov 08 20:12:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:12:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9
Nov 08 20:12:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf
Nov 08 20:12:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:12:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:19 user nova-compute[74638]: FIRMWARE:
Nov 08 20:12:19 user nova-compute[74638]: No targets found.
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:12:19 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:12:19 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc65ef62-7f82-4139-8c49-eff8bdc37773]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[504bc3b4-8800-43cc-8191-63ac18f3626d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c380160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9'): ({'sdf'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Removing single pathed devices sdf {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[029fc900-5bb4-4734-a292-1d8713d71304]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No VIF found with MAC fa:16:3e:63:61:cb, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[74276090-bacb-4b43-a5b1-87798733a034]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Flushing IO for device /dev/sdf {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbefde5-5eca-4db6-af0b-07571153da5e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e474fc7d-e35a-4457-aca2-e9417f8b0eb5]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] SCSI volumes sdf have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84f9e0e-5e20-410b-ab9c-17fae486f163]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-279ce8ca-0f58-4abc-a6e8-6d5e88e94f08 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.267s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.004s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[56092236-951b-45bd-a2da-5abc4bbf94f7]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9, portal: 172.16.0.220,3260]
Nov 08 20:12:19 user nova-compute[74638]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9, portal: 172.16.0.220,3260] successful.
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fef1b92-755c-45c5-abb1-deae92811bb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5564add8-3abd-4fc5-8b16-7b6c16edb285]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== disconnect_volume: return (367ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMGdizJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:19 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a575001e-ac14-47db-883e-c510bf962820]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:12:19 user nova-compute[74638]: No targets found.
Nov 08 20:12:19 user nova-compute[74638]: iSNS:
Nov 08 20:12:19 user nova-compute[74638]: No targets found.
Nov 08 20:12:19 user nova-compute[74638]: STATIC:
Nov 08 20:12:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:12:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf
Nov 08 20:12:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:19 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:12:19 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:19 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:19 user nova-compute[74638]: FIRMWARE:
Nov 08 20:12:19 user nova-compute[74638]: No targets found.
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:12:19 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:12:19 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e58975-b81f-4e61-97be-0ca7eba26b87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e2bbb-36b8-466d-befa-e0527a619cab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:19 user nova-compute[74638]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf (non-flash)
Nov 08 20:12:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c23c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3685b8-f4e1-4624-8730-5f929fca7fa9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3387e206-0107-48ee-9475-335e86af5edb]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db561a2-fd9e-4cad-9032-b4eb90bc10a6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06129a8-cc0f-4bd3-868e-0d56458c9bed]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eed34a5-f53e-48e2-b216-ff6e1a5d353a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[27186616-57f4-4b0a-84c1-6cea94c33a6c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf, portal: 172.16.0.220,3260]
Nov 08 20:12:20 user nova-compute[74638]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf, portal: 172.16.0.220,3260] successful.
Nov 08 20:12:20 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2fe4f4a-c2c8-4b06-8467-b99cadc6ecbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6243407-c9c4-4b2d-bb82-6544dada8a72]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] <== disconnect_volume: return (350ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:12:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Deleting instance files /opt/stack/data/nova/instances/a690cfa9-2a34-43a9-843b-e7548703a5e3_del
Nov 08 20:12:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Deletion of /opt/stack/data/nova/instances/a690cfa9-2a34-43a9-843b-e7548703a5e3_del complete
Nov 08 20:12:20 user nova-compute[74638]: INFO nova.compute.manager [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Took 4.09 seconds to destroy the instance on the hypervisor.
Nov 08 20:12:20 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:12:20 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:21 user nova-compute[74638]: WARNING nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-31ed79ac-1c5f-4569-977b-afa85fec9d49 for instance with vm_state active and task_state deleting.
Nov 08 20:12:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-unplugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-unplugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Acquiring lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] No waiting events found dispatching network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:21 user nova-compute[74638]: WARNING nova.compute.manager [req-488e2865-6111-46ad-86a1-e2bcd8d73942 req-04b5d42f-e2bb-4b8d-a2de-6d894849e521 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received unexpected event network-vif-plugged-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 for instance with vm_state active and task_state deleting.
Nov 08 20:12:21 user nova-compute[74638]: INFO nova.compute.manager [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Rebuilding instance
Nov 08 20:12:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-970ee678-a0c2-41b3-9117-7fd46a562ef7 req-5def549a-d984-4460-b226-898498964d3f service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-970ee678-a0c2-41b3-9117-7fd46a562ef7 req-5def549a-d984-4460-b226-898498964d3f service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-970ee678-a0c2-41b3-9117-7fd46a562ef7 req-5def549a-d984-4460-b226-898498964d3f service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-970ee678-a0c2-41b3-9117-7fd46a562ef7 req-5def549a-d984-4460-b226-898498964d3f service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-970ee678-a0c2-41b3-9117-7fd46a562ef7 req-5def549a-d984-4460-b226-898498964d3f service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:22 user nova-compute[74638]: WARNING nova.compute.manager [req-970ee678-a0c2-41b3-9117-7fd46a562ef7 req-5def549a-d984-4460-b226-898498964d3f service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state active and task_state rebuilding.
Nov 08 20:12:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:22 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance destroyed successfully.
Nov 08 20:12:22 user nova-compute[74638]: INFO nova.compute.manager [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Detaching volume 879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:12:22 user nova-compute[74638]: INFO nova.virt.block_device [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Attempting to driver detach volume 879763b7-beb0-41a3-93e2-0f8b3388f126 from mountpoint /dev/vdb
Nov 08 20:12:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Attempting to detach device vdb from instance a8f5663b-ac6f-4037-96c8-94152295e07e from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:12:22 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:12:22 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:12:22 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:12:22 user nova-compute[74638]:   <serial>879763b7-beb0-41a3-93e2-0f8b3388f126</serial>
Nov 08 20:12:22 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:12:22 user nova-compute[74638]: </disk>
Nov 08 20:12:22 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:12:22 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully detached device vdb from instance a8f5663b-ac6f-4037-96c8-94152295e07e from the persistent domain config.
Nov 08 20:12:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOrkFjpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:22 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a98c01-a1bf-43aa-ae1d-def2e3681b7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:12:22 user nova-compute[74638]: No targets found.
Nov 08 20:12:22 user nova-compute[74638]: iSNS:
Nov 08 20:12:22 user nova-compute[74638]: No targets found.
Nov 08 20:12:22 user nova-compute[74638]: STATIC:
Nov 08 20:12:22 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:12:22 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:22 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:22 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:12:22 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:22 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:22 user nova-compute[74638]: FIRMWARE:
Nov 08 20:12:22 user nova-compute[74638]: No targets found.
Nov 08 20:12:22 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:12:22 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:12:22 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d9aa4e-8303-4438-90c3-0cbcb6b4a14a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1346ffe0-20cf-4487-9e0c-282ed6f91c2c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:22 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:22 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:22 user nova-compute[74638]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:22 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c06d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65efb25-ca5e-4d7d-8d60-09d3f765d1ee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[221df401-91f0-44e1-868b-4fdac4c0cbd4]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e705ec-13cb-41b6-a5a3-f3e6a26fe116]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5e4b47-e536-4a8b-98f4-c8288572b27b]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:12:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f89daa-bcfc-4ea0-9351-2cb74a722b4d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[57949730-236b-42ee-a9ba-4fb73d240541]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260]
Nov 08 20:12:23 user nova-compute[74638]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260] successful.
Nov 08 20:12:23 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[78603248-4327-4df9-93eb-19a9785d695c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== disconnect_volume: return (358ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-1239d0e9-475d-4134-b630-468b4dcda28a req-50acb025-9c29-47ca-bd29-121e6a1519c0 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-deleted-31ed79ac-1c5f-4569-977b-afa85fec9d49 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:23 user nova-compute[74638]: INFO nova.compute.manager [req-1239d0e9-475d-4134-b630-468b4dcda28a req-50acb025-9c29-47ca-bd29-121e6a1519c0 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Neutron deleted interface 31ed79ac-1c5f-4569-977b-afa85fec9d49; detaching it from the instance and deleting it from the info cache
Nov 08 20:12:23 user nova-compute[74638]: DEBUG nova.network.neutron [req-1239d0e9-475d-4134-b630-468b4dcda28a req-50acb025-9c29-47ca-bd29-121e6a1519c0 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [{"id": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "address": "fa:16:3e:8a:d0:13", "network": {"id": "ae4577e8-6ac7-46bb-89e7-cd00dd68ccc8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1291197465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39f6ae3f-37", "ovs_interfaceid": "39f6ae3f-3753-4366-9981-c55d3e1c5742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "address": "fa:16:3e:9a:47:08", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a3d17e-e8", "ovs_interfaceid": "e1a3d17e-e8d3-4352-9ad5-7b7f022e3f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "address": "fa:16:3e:8e:85:2a", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fdd908-47", "ovs_interfaceid": "d2fdd908-4718-40b1-9b99-5ebf4604b9df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14326ab0-0b69-421f-a8f2-415d96da78ae", "address": "fa:16:3e:e0:e5:b3", "network": {"id": "e259c557-e727-4bad-a8a6-7b49e94a9ceb", "bridge": "br-int", "label": "tempest-device-tagging-net1-237345306", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14326ab0-0b", "ovs_interfaceid": "14326ab0-0b69-421f-a8f2-415d96da78ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "address": "fa:16:3e:20:fa:68", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6b4dcd-90", "ovs_interfaceid": "6a6b4dcd-90cb-4c1c-b2e4-f128d950e805", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "address": "fa:16:3e:92:98:d8", "network": {"id": "ef8cb62f-d72a-448d-8c9e-d1a835f9fe72", "bridge": "br-int", "label": "tempest-device-tagging-net2-811453272", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "33f19fa23d934a7ea5ffb026c605c8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda4bb7c-99", "ovs_interfaceid": "dda4bb7c-991c-4ed3-893f-1db9ef50c161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-1239d0e9-475d-4134-b630-468b4dcda28a req-50acb025-9c29-47ca-bd29-121e6a1519c0 service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Detach interface failed, port_id=31ed79ac-1c5f-4569-977b-afa85fec9d49, reason: Instance a690cfa9-2a34-43a9-843b-e7548703a5e3 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:12:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-08b5c191-0ecb-46f7-931b-c7d6681444b9 req-9ea1b1e4-733b-4a59-a641-531d3e5c4121 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-08b5c191-0ecb-46f7-931b-c7d6681444b9 req-9ea1b1e4-733b-4a59-a641-531d3e5c4121 service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-08b5c191-0ecb-46f7-931b-c7d6681444b9 req-9ea1b1e4-733b-4a59-a641-531d3e5c4121 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-08b5c191-0ecb-46f7-931b-c7d6681444b9 req-9ea1b1e4-733b-4a59-a641-531d3e5c4121 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-08b5c191-0ecb-46f7-931b-c7d6681444b9 req-9ea1b1e4-733b-4a59-a641-531d3e5c4121 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:24 user nova-compute[74638]: WARNING nova.compute.manager [req-08b5c191-0ecb-46f7-931b-c7d6681444b9 req-9ea1b1e4-733b-4a59-a641-531d3e5c4121 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state active and task_state rebuilding.
Nov 08 20:12:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance destroyed successfully.
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-116077949',display_name='tempest-ServerActionsTestOtherA-server-1716522574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-116077949',id=13,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi+eiPDqr6HlSxIQXH10Azfpx5sZFk+jXLb7JAwxAhz2gsJtoPLkM7/afKnSfkwD64rnPqNXm5hNSYOOnXFXGL2P8MItyH/1MyEiogdDVC1Nfak4q9GTrUuVYpG2ko6aA==',key_name='tempest-keypair-253147816',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-wsqgnlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=a8f5663b-ac6f-4037-96c8-94152295e07e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_vif [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36206fb4-fe, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8e8aafd-537c-4aa3-a7ce-aff3d4f3a4a7) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:24 user nova-compute[74638]: INFO os_vif [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe')
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOrkFjpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:24 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc49ee3-39a3-4522-9dd6-63256b9800a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:12:24 user nova-compute[74638]: No targets found.
Nov 08 20:12:24 user nova-compute[74638]: iSNS:
Nov 08 20:12:24 user nova-compute[74638]: No targets found.
Nov 08 20:12:24 user nova-compute[74638]: STATIC:
Nov 08 20:12:24 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:12:24 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:12:24 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:12:24 user nova-compute[74638]: FIRMWARE:
Nov 08 20:12:24 user nova-compute[74638]: No targets found.
Nov 08 20:12:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:12:24 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:12:24 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d803bcec-13ae-4609-b190-dfb8c2d8052d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de7f2f-1bc9-476d-a3c8-7ffe6fde8110]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c23cca0>, {}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Disconnecting from: [] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== disconnect_volume: return (88ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:12:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Deleting instance files /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e_del
Nov 08 20:12:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Deletion of /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e_del complete
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:24 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Took 4.28 seconds to deallocate network for instance.
Nov 08 20:12:24 user nova-compute[74638]: INFO nova.virt.block_device [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Booting with volume 879763b7-beb0-41a3-93e2-0f8b3388f126 at /dev/vdb
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.utils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[06719ff4-5356-49cf-9ed3-1a0715c31696]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.volume.cinder [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Update attachment failed for attachment 03d1e231-2fae-4792-ba76-62a777b4b07f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e157034-8769-4fbf-bf95-b730bda743ca) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e157034-8769-4fbf-bf95-b730bda743ca)
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0635ca-3316-4de4-be8b-bb6d71b224fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e157034-8769-4fbf-bf95-b730bda743ca)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Traceback (most recent call last):
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     driver_block_device.attach_block_devices(
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     _log_and_attach(device)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     self._do_attach(context, instance, volume, volume_api,
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     self._volume_attach(context, volume, connector, instance,
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     connection_info = volume_api.attachment_update(
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     res = method(self, ctx, *args, **kwargs)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     with excutils.save_and_reraise_exception():
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     self.force_reraise()
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     raise self.value
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     return method.func(obj, *args, **kwargs)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     resp = self._update('/attachments/%s' % id, body)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     return self.request(url, method, **kwargs)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782]     raise exceptions.from_response(resp, body)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e157034-8769-4fbf-bf95-b730bda743ca)
Nov 08 20:12:24 user nova-compute[74638]: ERROR nova.compute.manager [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] 
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.compute.claims [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Aborting claim: <nova.compute.claims.Claim object at 0x7fe54c5515a0> {{(pid=74638) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c3190-66db-41c0-a606-3472b2f7bb09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bda98ba-1881-4492-8cf4-9072a6bccc90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:12:24 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:12:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0e5420-26ad-424f-8330-9debbca544e2]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG os_brick.utils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updating existing volume attachment record: a9311cc2-4a07-4e70-906f-81821d9e53ee {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:12:24 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.432s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Build of instance 466df7f1-8c73-4aa4-8d82-deb194a42782 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e157034-8769-4fbf-bf95-b730bda743ca) {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.utils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Build of instance 466df7f1-8c73-4aa4-8d82-deb194a42782 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74638) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 20:12:25 user nova-compute[74638]: ERROR nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Build of instance 466df7f1-8c73-4aa4-8d82-deb194a42782 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e157034-8769-4fbf-bf95-b730bda743ca): nova.exception.BuildAbortException: Build of instance 466df7f1-8c73-4aa4-8d82-deb194a42782 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e157034-8769-4fbf-bf95-b730bda743ca)
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Unplugging VIFs for instance {{(pid=74638) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:12:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-497122852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-497122852',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOpxpoWU5iHcprOkCE4Pii92MwAH25aWDdNURJGrO/3+rSo6LR7ybzOp+10gukeVNaqi5OA9URYd1SLsmjM0OfL4YloS56TWiFCuiu2b0uWo5FHND6q6aUfLQM+YtgC9Q==',key_name='tempest-keypair-642046552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee96fbc2bc244d7a997392d322544d67',ramdisk_id='',reservation_id='r-l9eu0xkq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1404652930',owner_user_name='tempest-ServerActionsV293TestJSON-1404652930-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f86f60b7a12b431ba675a336f8dfa064',uuid=466df7f1-8c73-4aa4-8d82-deb194a42782,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49dde973-6c58-41d6-8571-48988dc3f5d9", "address": "fa:16:3e:d8:52:e1", "network": {"id": "12cdd1aa-a808-43d7-baa0-f8bb831c18f4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1375456694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee96fbc2bc244d7a997392d322544d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dde973-6c", "ovs_interfaceid": "49dde973-6c58-41d6-8571-48988dc3f5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Converting VIF {"id": "49dde973-6c58-41d6-8571-48988dc3f5d9", "address": "fa:16:3e:d8:52:e1", "network": {"id": "12cdd1aa-a808-43d7-baa0-f8bb831c18f4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1375456694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee96fbc2bc244d7a997392d322544d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dde973-6c", "ovs_interfaceid": "49dde973-6c58-41d6-8571-48988dc3f5d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=49dde973-6c58-41d6-8571-48988dc3f5d9,network=Network(12cdd1aa-a808-43d7-baa0-f8bb831c18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dde973-6c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG os_vif [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=49dde973-6c58-41d6-8571-48988dc3f5d9,network=Network(12cdd1aa-a808-43d7-baa0-f8bb831c18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dde973-6c') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49dde973-6c, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:12:25 user nova-compute[74638]: INFO os_vif [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=49dde973-6c58-41d6-8571-48988dc3f5d9,network=Network(12cdd1aa-a808-43d7-baa0-f8bb831c18f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dde973-6c')
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Unplugged VIFs for instance {{(pid=74638) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-63a1338e-c568-447a-b0d1-86c203f5e781 req-b615b759-2156-42d0-b5e4-a88eb28c93ce service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-deleted-39f6ae3f-3753-4366-9981-c55d3e1c5742 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-63a1338e-c568-447a-b0d1-86c203f5e781 req-b615b759-2156-42d0-b5e4-a88eb28c93ce service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-deleted-14326ab0-0b69-421f-a8f2-415d96da78ae {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-63a1338e-c568-447a-b0d1-86c203f5e781 req-b615b759-2156-42d0-b5e4-a88eb28c93ce service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-deleted-6a6b4dcd-90cb-4c1c-b2e4-f128d950e805 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-63a1338e-c568-447a-b0d1-86c203f5e781 req-b615b759-2156-42d0-b5e4-a88eb28c93ce service nova] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Received event network-vif-deleted-dda4bb7c-991c-4ed3-893f-1db9ef50c161 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:25 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:12:25 user nova-compute[74638]: INFO nova.compute.claims [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Claim successful on node user
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.network.neutron [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:26 user nova-compute[74638]: INFO nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Took 1.11 seconds to deallocate network for instance.
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Detaching volume: 4a4dff36-ba6e-4ebd-abc2-6496e28b51f1 {{(pid=74638) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 20:12:26 user nova-compute[74638]: INFO nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Detaching volume 4a4dff36-ba6e-4ebd-abc2-6496e28b51f1
Nov 08 20:12:26 user nova-compute[74638]: ERROR nova.virt.block_device [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Unable to call for a driver detach of volume 4a4dff36-ba6e-4ebd-abc2-6496e28b51f1 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 466df7f1-8c73-4aa4-8d82-deb194a42782 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6e157034-8769-4fbf-bf95-b730bda743ca)
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] Deleting volume: 4a4dff36-ba6e-4ebd-abc2-6496e28b51f1 {{(pid=74638) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:12:26 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.policy [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa581d9fbb664526bfabb540888b2779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d8305b8bf4f3c8083aabe8768c906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:12:26 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Deleted allocations for instance 466df7f1-8c73-4aa4-8d82-deb194a42782
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-1f5bce8a-4330-4844-8fa0-d2a739f1e37a tempest-ServerActionsV293TestJSON-1404652930 tempest-ServerActionsV293TestJSON-1404652930-project-member] Lock "466df7f1-8c73-4aa4-8d82-deb194a42782" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.203s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "466df7f1-8c73-4aa4-8d82-deb194a42782" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.128s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:26 user nova-compute[74638]: INFO nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 466df7f1-8c73-4aa4-8d82-deb194a42782] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "466df7f1-8c73-4aa4-8d82-deb194a42782" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:12:26 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Creating image(s)
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "/opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "/opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "/opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk 1073741824" returned: 0 in 0.073s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Successfully created port: ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.199s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Cannot resize image /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Ensure instance console log exists: /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Successfully updated port: ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquired lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:12:27 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updating instance_info_cache with network_info: [{"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Releasing lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Instance network_info: |[{"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Start _get_guest_xml network_info=[{"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:12:28 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:12:28 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1693000362',display_name='tempest-VolumesAdminNegativeTest-server-1693000362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1693000362',id=16,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoPo8hewdQGhZ/Hw6E5nFLoXDlY61KWiaxrCFx1+8OiX383Tgb/2ol/oBwETsQEBlJOykWj+GhgIYmPaNASszPP8LYKsU+tMHNlJgkWna/wgOjWhvduTSyiscFRch21sA==',key_name='tempest-keypair-644661497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335d8305b8bf4f3c8083aabe8768c906',ramdisk_id='',reservation_id='r-po0cqcf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1731747303',owner_user_name='tempest-VolumesAdminNegativeTest-1731747303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa581d9fbb664526bfabb540888b2779',uuid=105b86cf-4f0f-4003-8407-42b945553b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converting VIF {"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac29bfff-79d2-42a9-99c4-8d7dce3705fc,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac29bfff-79') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lazy-loading 'pci_devices' on Instance uuid 105b86cf-4f0f-4003-8407-42b945553b18 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:12:28 user nova-compute[74638]:   <uuid>105b86cf-4f0f-4003-8407-42b945553b18</uuid>
Nov 08 20:12:28 user nova-compute[74638]:   <name>instance-00000010</name>
Nov 08 20:12:28 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:12:28 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:12:28 user nova-compute[74638]:   <metadata>
Nov 08 20:12:28 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:12:28 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:12:28 user nova-compute[74638]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1693000362</nova:name>
Nov 08 20:12:28 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:12:28</nova:creationTime>
Nov 08 20:12:28 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:12:28 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:12:28 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:12:28 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:12:28 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:12:28 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:12:28 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:12:28 user nova-compute[74638]:       <nova:owner>
Nov 08 20:12:28 user nova-compute[74638]:         <nova:user uuid="fa581d9fbb664526bfabb540888b2779">tempest-VolumesAdminNegativeTest-1731747303-project-member</nova:user>
Nov 08 20:12:28 user nova-compute[74638]:         <nova:project uuid="335d8305b8bf4f3c8083aabe8768c906">tempest-VolumesAdminNegativeTest-1731747303</nova:project>
Nov 08 20:12:28 user nova-compute[74638]:       </nova:owner>
Nov 08 20:12:28 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:12:28 user nova-compute[74638]:       <nova:ports>
Nov 08 20:12:28 user nova-compute[74638]:         <nova:port uuid="ac29bfff-79d2-42a9-99c4-8d7dce3705fc">
Nov 08 20:12:28 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 20:12:28 user nova-compute[74638]:         </nova:port>
Nov 08 20:12:28 user nova-compute[74638]:       </nova:ports>
Nov 08 20:12:28 user nova-compute[74638]:     </nova:instance>
Nov 08 20:12:28 user nova-compute[74638]:   </metadata>
Nov 08 20:12:28 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:12:28 user nova-compute[74638]:     <system>
Nov 08 20:12:28 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:12:28 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:12:28 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:12:28 user nova-compute[74638]:       <entry name="serial">105b86cf-4f0f-4003-8407-42b945553b18</entry>
Nov 08 20:12:28 user nova-compute[74638]:       <entry name="uuid">105b86cf-4f0f-4003-8407-42b945553b18</entry>
Nov 08 20:12:28 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:12:28 user nova-compute[74638]:     </system>
Nov 08 20:12:28 user nova-compute[74638]:   </sysinfo>
Nov 08 20:12:28 user nova-compute[74638]:   <os>
Nov 08 20:12:28 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:12:28 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:12:28 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:12:28 user nova-compute[74638]:   </os>
Nov 08 20:12:28 user nova-compute[74638]:   <features>
Nov 08 20:12:28 user nova-compute[74638]:     <acpi/>
Nov 08 20:12:28 user nova-compute[74638]:     <apic/>
Nov 08 20:12:28 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:12:28 user nova-compute[74638]:   </features>
Nov 08 20:12:28 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:12:28 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:12:28 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:12:28 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:12:28 user nova-compute[74638]:   </clock>
Nov 08 20:12:28 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:12:28 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:12:28 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:12:28 user nova-compute[74638]:   </cpu>
Nov 08 20:12:28 user nova-compute[74638]:   <devices>
Nov 08 20:12:28 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:12:28 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:12:28 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk"/>
Nov 08 20:12:28 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:12:28 user nova-compute[74638]:     </disk>
Nov 08 20:12:28 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:12:28 user nova-compute[74638]:       <mac address="fa:16:3e:eb:23:b7"/>
Nov 08 20:12:28 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:12:28 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:12:28 user nova-compute[74638]:       <target dev="tapac29bfff-79"/>
Nov 08 20:12:28 user nova-compute[74638]:     </interface>
Nov 08 20:12:28 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:12:28 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/console.log" append="off"/>
Nov 08 20:12:28 user nova-compute[74638]:     </serial>
Nov 08 20:12:28 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:12:28 user nova-compute[74638]:     <video>
Nov 08 20:12:28 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:12:28 user nova-compute[74638]:     </video>
Nov 08 20:12:28 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:12:28 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:12:28 user nova-compute[74638]:     </rng>
Nov 08 20:12:28 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:12:28 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:12:28 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:12:28 user nova-compute[74638]:     </memballoon>
Nov 08 20:12:28 user nova-compute[74638]:   </devices>
Nov 08 20:12:28 user nova-compute[74638]: </domain>
Nov 08 20:12:28 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1693000362',display_name='tempest-VolumesAdminNegativeTest-server-1693000362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1693000362',id=16,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoPo8hewdQGhZ/Hw6E5nFLoXDlY61KWiaxrCFx1+8OiX383Tgb/2ol/oBwETsQEBlJOykWj+GhgIYmPaNASszPP8LYKsU+tMHNlJgkWna/wgOjWhvduTSyiscFRch21sA==',key_name='tempest-keypair-644661497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335d8305b8bf4f3c8083aabe8768c906',ramdisk_id='',reservation_id='r-po0cqcf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1731747303',owner_user_name='tempest-VolumesAdminNegativeTest-1731747303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa581d9fbb664526bfabb540888b2779',uuid=105b86cf-4f0f-4003-8407-42b945553b18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converting VIF {"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac29bfff-79d2-42a9-99c4-8d7dce3705fc,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac29bfff-79') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG os_vif [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac29bfff-79d2-42a9-99c4-8d7dce3705fc,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac29bfff-79') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8baa8f3e-75d5-5a91-afff-a94f19c715ba', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac29bfff-79, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac29bfff-79, col_values=(('qos', UUID('9a64a240-546e-487d-932b-b87fbb877af6')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac29bfff-79, col_values=(('external_ids', {'iface-id': 'ac29bfff-79d2-42a9-99c4-8d7dce3705fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:23:b7', 'vm-uuid': '105b86cf-4f0f-4003-8407-42b945553b18'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:28 user nova-compute[74638]: INFO os_vif [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac29bfff-79d2-42a9-99c4-8d7dce3705fc,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac29bfff-79')
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:12:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] No VIF found with MAC fa:16:3e:eb:23:b7, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-91d1469d-9539-4a28-8fe4-11ac805acbb1 req-f8017673-ef63-4923-95be-145fffa22f4e service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received event network-changed-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-91d1469d-9539-4a28-8fe4-11ac805acbb1 req-f8017673-ef63-4923-95be-145fffa22f4e service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Refreshing instance network info cache due to event network-changed-ac29bfff-79d2-42a9-99c4-8d7dce3705fc. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-91d1469d-9539-4a28-8fe4-11ac805acbb1 req-f8017673-ef63-4923-95be-145fffa22f4e service nova] Acquiring lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-91d1469d-9539-4a28-8fe4-11ac805acbb1 req-f8017673-ef63-4923-95be-145fffa22f4e service nova] Acquired lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-91d1469d-9539-4a28-8fe4-11ac805acbb1 req-f8017673-ef63-4923-95be-145fffa22f4e service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Refreshing network info cache for port ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-91d1469d-9539-4a28-8fe4-11ac805acbb1 req-f8017673-ef63-4923-95be-145fffa22f4e service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updated VIF entry in instance network info cache for port ac29bfff-79d2-42a9-99c4-8d7dce3705fc. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-91d1469d-9539-4a28-8fe4-11ac805acbb1 req-f8017673-ef63-4923-95be-145fffa22f4e service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updating instance_info_cache with network_info: [{"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-91d1469d-9539-4a28-8fe4-11ac805acbb1 req-f8017673-ef63-4923-95be-145fffa22f4e service nova] Releasing lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-1573d147-aba2-42bb-b92e-46f1659ed9fb req-ab9d9c2c-4cfc-4d2e-8f3d-4a7f04f0710d service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received event network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1573d147-aba2-42bb-b92e-46f1659ed9fb req-ab9d9c2c-4cfc-4d2e-8f3d-4a7f04f0710d service nova] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1573d147-aba2-42bb-b92e-46f1659ed9fb req-ab9d9c2c-4cfc-4d2e-8f3d-4a7f04f0710d service nova] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1573d147-aba2-42bb-b92e-46f1659ed9fb req-ab9d9c2c-4cfc-4d2e-8f3d-4a7f04f0710d service nova] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-1573d147-aba2-42bb-b92e-46f1659ed9fb req-ab9d9c2c-4cfc-4d2e-8f3d-4a7f04f0710d service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] No waiting events found dispatching network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:30 user nova-compute[74638]: WARNING nova.compute.manager [req-1573d147-aba2-42bb-b92e-46f1659ed9fb req-ab9d9c2c-4cfc-4d2e-8f3d-4a7f04f0710d service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received unexpected event network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc for instance with vm_state building and task_state spawning.
Nov 08 20:12:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:12:32 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Instance spawned successfully.
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:32 user nova-compute[74638]: INFO nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:12:32 user nova-compute[74638]: INFO nova.compute.manager [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Took 6.47 seconds to build instance.
Nov 08 20:12:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c21749e7-56ff-4039-99e6-3afa658d2976 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.577s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-a2202985-7f24-4675-9f32-508fd32639c0 req-72ff1712-dfd9-401e-9db4-02353bb5720b service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received event network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a2202985-7f24-4675-9f32-508fd32639c0 req-72ff1712-dfd9-401e-9db4-02353bb5720b service nova] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a2202985-7f24-4675-9f32-508fd32639c0 req-72ff1712-dfd9-401e-9db4-02353bb5720b service nova] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a2202985-7f24-4675-9f32-508fd32639c0 req-72ff1712-dfd9-401e-9db4-02353bb5720b service nova] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-a2202985-7f24-4675-9f32-508fd32639c0 req-72ff1712-dfd9-401e-9db4-02353bb5720b service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] No waiting events found dispatching network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:32 user nova-compute[74638]: WARNING nova.compute.manager [req-a2202985-7f24-4675-9f32-508fd32639c0 req-72ff1712-dfd9-401e-9db4-02353bb5720b service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received unexpected event network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc for instance with vm_state active and task_state None.
Nov 08 20:12:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:36 user nova-compute[74638]: INFO nova.compute.manager [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] [instance: a690cfa9-2a34-43a9-843b-e7548703a5e3] Took 11.86 seconds to detach 3 volumes for instance.
Nov 08 20:12:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:36 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:12:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:12:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:36 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Deleted allocations for instance a690cfa9-2a34-43a9-843b-e7548703a5e3
Nov 08 20:12:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-16344582-b521-4d26-9363-6f0923f721d3 tempest-TaggedBootDevicesTest-1750493064 tempest-TaggedBootDevicesTest-1750493064-project-member] Lock "a690cfa9-2a34-43a9-843b-e7548703a5e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.872s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:12:49 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Creating image(s)
Nov 08 20:12:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.243s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk 1073741824" returned: 0 in 0.057s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Cannot resize image /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Ensure instance console log exists: /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Start _get_guest_xml network_info=[{"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'a9311cc2-4a07-4e70-906f-81821d9e53ee', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOrkFjpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8f5663b-ac6f-4037-96c8-94152295e07e', 'attached_at': '', 'detached_at': '', 'volume_id': '879763b7-beb0-41a3-93e2-0f8b3388f126', 'serial': '879763b7-beb0-41a3-93e2-0f8b3388f126'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:12:50 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 20:12:50 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.objects.instance [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8f5663b-ac6f-4037-96c8-94152295e07e {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOrkFjpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:12:50 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:50 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:12:50 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e93fc5a-4c06-4ba0-a745-6cef951f13e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:12:50 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8f1dc-32bb-4d79-a700-89f6288b84e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126] added
Nov 08 20:12:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8af2b1a-6dce-4ae0-ba83-3b8291fc9db7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780d6b7-9b04-40cc-a436-ab64ae928ec6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TOrkFjpn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TOrkFjpn" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dae3ff4-1677-4746-9d19-db4f105a4851]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TOrkFjpn'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f19c8b1-ac92-4d1e-a86b-9f13e88d0e39]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0408f68e-9d45-47b8-a19d-21bb51be358a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:51 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:51 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0735efec-ac0a-44ec-adda-f2308466e77b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260]
Nov 08 20:12:51 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260] successful.
Nov 08 20:12:51 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e258a7-cdde-4a0e-9113-5278fae24970]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[429ade8f-bc3e-41a5-969c-292fcc615bb2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:51 user nova-compute[74638]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:51 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:12:51 user nova-compute[74638]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:12:51 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a4469-7001-4900-a8d9-45a0fba08714]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:12:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOrkFjpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26265666436653538', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265666436653538', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-116077949',display_name='tempest-ServerActionsTestOtherA-server-1716522574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-116077949',id=13,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi+eiPDqr6HlSxIQXH10Azfpx5sZFk+jXLb7JAwxAhz2gsJtoPLkM7/afKnSfkwD64rnPqNXm5hNSYOOnXFXGL2P8MItyH/1MyEiogdDVC1Nfak4q9GTrUuVYpG2ko6aA==',key_name='tempest-keypair-253147816',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-wsqgnlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=a8f5663b-ac6f-4037-96c8-94152295e07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:12:52 user nova-compute[74638]:   <uuid>a8f5663b-ac6f-4037-96c8-94152295e07e</uuid>
Nov 08 20:12:52 user nova-compute[74638]:   <name>instance-0000000d</name>
Nov 08 20:12:52 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:12:52 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:12:52 user nova-compute[74638]:   <metadata>
Nov 08 20:12:52 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:12:52 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:12:52 user nova-compute[74638]:       <nova:name>tempest-ServerActionsTestOtherA-server-1716522574</nova:name>
Nov 08 20:12:52 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:12:50</nova:creationTime>
Nov 08 20:12:52 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:12:52 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:12:52 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:12:52 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:12:52 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:12:52 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:12:52 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:12:52 user nova-compute[74638]:       <nova:owner>
Nov 08 20:12:52 user nova-compute[74638]:         <nova:user uuid="fc302495f45a4ae1bd2524aa60ecbc85">tempest-ServerActionsTestOtherA-1281886616-project-member</nova:user>
Nov 08 20:12:52 user nova-compute[74638]:         <nova:project uuid="4d0b2492206349f197739ee10c95a28f">tempest-ServerActionsTestOtherA-1281886616</nova:project>
Nov 08 20:12:52 user nova-compute[74638]:       </nova:owner>
Nov 08 20:12:52 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:12:52 user nova-compute[74638]:       <nova:ports>
Nov 08 20:12:52 user nova-compute[74638]:         <nova:port uuid="36206fb4-fe9a-400f-90ff-cc2657e78bda">
Nov 08 20:12:52 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 20:12:52 user nova-compute[74638]:         </nova:port>
Nov 08 20:12:52 user nova-compute[74638]:       </nova:ports>
Nov 08 20:12:52 user nova-compute[74638]:     </nova:instance>
Nov 08 20:12:52 user nova-compute[74638]:   </metadata>
Nov 08 20:12:52 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:12:52 user nova-compute[74638]:     <system>
Nov 08 20:12:52 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:12:52 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:12:52 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:12:52 user nova-compute[74638]:       <entry name="serial">a8f5663b-ac6f-4037-96c8-94152295e07e</entry>
Nov 08 20:12:52 user nova-compute[74638]:       <entry name="uuid">a8f5663b-ac6f-4037-96c8-94152295e07e</entry>
Nov 08 20:12:52 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:12:52 user nova-compute[74638]:     </system>
Nov 08 20:12:52 user nova-compute[74638]:   </sysinfo>
Nov 08 20:12:52 user nova-compute[74638]:   <os>
Nov 08 20:12:52 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:12:52 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:12:52 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:12:52 user nova-compute[74638]:   </os>
Nov 08 20:12:52 user nova-compute[74638]:   <features>
Nov 08 20:12:52 user nova-compute[74638]:     <acpi/>
Nov 08 20:12:52 user nova-compute[74638]:     <apic/>
Nov 08 20:12:52 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:12:52 user nova-compute[74638]:   </features>
Nov 08 20:12:52 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:12:52 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:12:52 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:12:52 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:12:52 user nova-compute[74638]:   </clock>
Nov 08 20:12:52 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:12:52 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:12:52 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:12:52 user nova-compute[74638]:   </cpu>
Nov 08 20:12:52 user nova-compute[74638]:   <devices>
Nov 08 20:12:52 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:12:52 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:12:52 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk"/>
Nov 08 20:12:52 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:12:52 user nova-compute[74638]:     </disk>
Nov 08 20:12:52 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:12:52 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:12:52 user nova-compute[74638]:       <source dev="/dev/sdc"/>
Nov 08 20:12:52 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:12:52 user nova-compute[74638]:       <serial>879763b7-beb0-41a3-93e2-0f8b3388f126</serial>
Nov 08 20:12:52 user nova-compute[74638]:     </disk>
Nov 08 20:12:52 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:12:52 user nova-compute[74638]:       <mac address="fa:16:3e:63:61:cb"/>
Nov 08 20:12:52 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:12:52 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:12:52 user nova-compute[74638]:       <target dev="tap36206fb4-fe"/>
Nov 08 20:12:52 user nova-compute[74638]:     </interface>
Nov 08 20:12:52 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:12:52 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/console.log" append="off"/>
Nov 08 20:12:52 user nova-compute[74638]:     </serial>
Nov 08 20:12:52 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:12:52 user nova-compute[74638]:     <video>
Nov 08 20:12:52 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:12:52 user nova-compute[74638]:     </video>
Nov 08 20:12:52 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:12:52 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:12:52 user nova-compute[74638]:     </rng>
Nov 08 20:12:52 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:12:52 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:12:52 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:12:52 user nova-compute[74638]:     </memballoon>
Nov 08 20:12:52 user nova-compute[74638]:   </devices>
Nov 08 20:12:52 user nova-compute[74638]: </domain>
Nov 08 20:12:52 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-116077949',display_name='tempest-ServerActionsTestOtherA-server-1716522574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-116077949',id=13,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi+eiPDqr6HlSxIQXH10Azfpx5sZFk+jXLb7JAwxAhz2gsJtoPLkM7/afKnSfkwD64rnPqNXm5hNSYOOnXFXGL2P8MItyH/1MyEiogdDVC1Nfak4q9GTrUuVYpG2ko6aA==',key_name='tempest-keypair-253147816',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-wsqgnlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=a8f5663b-ac6f-4037-96c8-94152295e07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG os_vif [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6808b1d4-c1c8-5e40-a81c-3f9df3f99b1d', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36206fb4-fe, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36206fb4-fe, col_values=(('qos', UUID('4384f975-15ae-49a7-a3aa-d66d7b1b1dec')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36206fb4-fe, col_values=(('external_ids', {'iface-id': '36206fb4-fe9a-400f-90ff-cc2657e78bda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:61:cb', 'vm-uuid': 'a8f5663b-ac6f-4037-96c8-94152295e07e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:52 user nova-compute[74638]: INFO os_vif [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe')
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:12:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No VIF found with MAC fa:16:3e:63:61:cb, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:12:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-77e94eea-1ed8-449d-bafc-3c616e54b5b4 req-5f684ab2-cc2d-4dbe-b097-92eba0d26ea8 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-77e94eea-1ed8-449d-bafc-3c616e54b5b4 req-5f684ab2-cc2d-4dbe-b097-92eba0d26ea8 service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-77e94eea-1ed8-449d-bafc-3c616e54b5b4 req-5f684ab2-cc2d-4dbe-b097-92eba0d26ea8 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-77e94eea-1ed8-449d-bafc-3c616e54b5b4 req-5f684ab2-cc2d-4dbe-b097-92eba0d26ea8 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-77e94eea-1ed8-449d-bafc-3c616e54b5b4 req-5f684ab2-cc2d-4dbe-b097-92eba0d26ea8 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:54 user nova-compute[74638]: WARNING nova.compute.manager [req-77e94eea-1ed8-449d-bafc-3c616e54b5b4 req-5f684ab2-cc2d-4dbe-b097-92eba0d26ea8 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state active and task_state rebuild_spawning.
Nov 08 20:12:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:12:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-21a6423a-cb57-4200-9904-73b43d19d57a req-192b1b8e-d8a5-4d9b-9710-b5c10af12cd0 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-21a6423a-cb57-4200-9904-73b43d19d57a req-192b1b8e-d8a5-4d9b-9710-b5c10af12cd0 service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-21a6423a-cb57-4200-9904-73b43d19d57a req-192b1b8e-d8a5-4d9b-9710-b5c10af12cd0 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-21a6423a-cb57-4200-9904-73b43d19d57a req-192b1b8e-d8a5-4d9b-9710-b5c10af12cd0 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-21a6423a-cb57-4200-9904-73b43d19d57a req-192b1b8e-d8a5-4d9b-9710-b5c10af12cd0 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:12:56 user nova-compute[74638]: WARNING nova.compute.manager [req-21a6423a-cb57-4200-9904-73b43d19d57a req-192b1b8e-d8a5-4d9b-9710-b5c10af12cd0 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state active and task_state rebuild_spawning.
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:12:56 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance spawned successfully.
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG nova.objects.instance [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74638) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd00b1bf-a198-44ac-8042-fb92a09eec12 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.151s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:12:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:12:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:12:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:02 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:13:02 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=25.66811752319336GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 10037bd1-d710-4ce1-abe8-b1f5b657c828 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a8f5663b-ac6f-4037-96c8-94152295e07e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 1953f44c-b839-4515-a0b4-1212bfa93092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 105b86cf-4f0f-4003-8407-42b945553b18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:13:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:13:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:03 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:13:03 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:13:03 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:13:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:13:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:13:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:13:19 user nova-compute[74638]: INFO nova.compute.manager [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Detaching volume 22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:13:19 user nova-compute[74638]: INFO nova.virt.block_device [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Attempting to driver detach volume 22b1bf19-c5b4-4f16-8acc-a26cc4177a92 from mountpoint /dev/vdb
Nov 08 20:13:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Attempting to detach device vdb from instance f91c46b4-8ab6-4480-80e0-5e6df682e609 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:13:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:13:19 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:13:19 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:13:19 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:13:19 user nova-compute[74638]:   <serial>22b1bf19-c5b4-4f16-8acc-a26cc4177a92</serial>
Nov 08 20:13:19 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 20:13:19 user nova-compute[74638]: </disk>
Nov 08 20:13:19 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:13:19 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully detached device vdb from instance f91c46b4-8ab6-4480-80e0-5e6df682e609 from the persistent domain config.
Nov 08 20:13:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f91c46b4-8ab6-4480-80e0-5e6df682e609 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:13:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:13:19 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:13:19 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:13:19 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:13:19 user nova-compute[74638]:   <serial>22b1bf19-c5b4-4f16-8acc-a26cc4177a92</serial>
Nov 08 20:13:19 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 20:13:19 user nova-compute[74638]: </disk>
Nov 08 20:13:19 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:13:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "58fede94-cddc-4a5c-b223-e1894250147e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:13:21 user nova-compute[74638]: INFO nova.compute.claims [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Claim successful on node user
Nov 08 20:13:21 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:13:21 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:13:21 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:13:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:13:22 user nova-compute[74638]: INFO nova.virt.block_device [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Booting with volume 809f9f7e-7770-419e-b371-d843ec0e2ccb at /dev/vda
Nov 08 20:13:22 user nova-compute[74638]: DEBUG nova.policy [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44cdf63102fa4220946dc9b726622536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c8df0cff774621bc464646de80bbb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG os_brick.utils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57e0e43-6707-466c-ab10-064bfe1ace6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[533a881d-60b8-4401-9e4d-9d9282e4f055]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6d0058-7227-464f-88fd-f63620cbf143]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fdf424-a75a-4fa2-a7a2-e5fac274a9f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:13:22 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:13:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ede3c1c-5d77-4522-84a7-7c23aeec8ced]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG os_brick.utils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating existing volume attachment record: 93e6cc51-b643-4d9c-8742-d3d5058dd14f {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:13:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully created port: e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:13:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully created port: ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:13:24 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully created port: 3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:13:24 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully created port: f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:13:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully created port: 2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully updated port: e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-cbd96b64-ff64-4adc-81d2-9aeef56a3caf req-78826445-708f-4d01-98cd-251b9ee2a28c service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-changed-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-cbd96b64-ff64-4adc-81d2-9aeef56a3caf req-78826445-708f-4d01-98cd-251b9ee2a28c service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing instance network info cache due to event network-changed-e2bfa746-5623-4be5-a820-87dcf5200be7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cbd96b64-ff64-4adc-81d2-9aeef56a3caf req-78826445-708f-4d01-98cd-251b9ee2a28c service nova] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cbd96b64-ff64-4adc-81d2-9aeef56a3caf req-78826445-708f-4d01-98cd-251b9ee2a28c service nova] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG nova.network.neutron [req-cbd96b64-ff64-4adc-81d2-9aeef56a3caf req-78826445-708f-4d01-98cd-251b9ee2a28c service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing network info cache for port e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG nova.network.neutron [req-cbd96b64-ff64-4adc-81d2-9aeef56a3caf req-78826445-708f-4d01-98cd-251b9ee2a28c service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG nova.network.neutron [req-cbd96b64-ff64-4adc-81d2-9aeef56a3caf req-78826445-708f-4d01-98cd-251b9ee2a28c service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cbd96b64-ff64-4adc-81d2-9aeef56a3caf req-78826445-708f-4d01-98cd-251b9ee2a28c service nova] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:26 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully updated port: 15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:13:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:27 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully updated port: 069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-changed-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing instance network info cache due to event network-changed-15ce325a-9c59-41ab-b96a-c1da8bd15896. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.network.neutron [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing network info cache for port 15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.network.neutron [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.network.neutron [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-changed-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing instance network info cache due to event network-changed-069fbd24-f210-49d4-bf0e-28df125ddd0c. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.network.neutron [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing network info cache for port 069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:13:28 user nova-compute[74638]: DEBUG nova.network.neutron [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:13:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully updated port: ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:13:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fca88f5c-3ea0-42ca-a83b-fc8e292120ba req-08a51117-5a6f-4cfa-b8e2-9e6d3bad5ea2 service nova] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully updated port: 3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-changed-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing instance network info cache due to event network-changed-ff9effc3-791c-4844-bfd7-3032135bb091. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing network info cache for port ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-changed-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing instance network info cache due to event network-changed-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing network info cache for port 3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:13:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:13:31 user nova-compute[74638]: DEBUG nova.network.neutron [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d2432c4-1b0f-4004-a5b3-0108f853876a req-d3da3ae7-7015-435f-8176-3ee03bd4f844 service nova] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully updated port: f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:13:32 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Successfully updated port: 2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:13:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:32 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:13:32 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:13:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-changed-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing instance network info cache due to event network-changed-f446962d-48ce-4b5f-b105-d762c2338a0e. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:13:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [{"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance network_info: |[{"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:13:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:34 user nova-compute[74638]: DEBUG nova.network.neutron [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing network info cache for port f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-e127d1e4-489b-48e4-9975-f58c79658435 req-fc5cbbc2-af7f-4677-982e-62a46570734f service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-changed-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-e127d1e4-489b-48e4-9975-f58c79658435 req-fc5cbbc2-af7f-4677-982e-62a46570734f service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Refreshing instance network info cache due to event network-changed-d614c985-f857-4c70-8c85-978502f3d371. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e127d1e4-489b-48e4-9975-f58c79658435 req-fc5cbbc2-af7f-4677-982e-62a46570734f service nova] Acquiring lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e127d1e4-489b-48e4-9975-f58c79658435 req-fc5cbbc2-af7f-4677-982e-62a46570734f service nova] Acquired lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-e127d1e4-489b-48e4-9975-f58c79658435 req-fc5cbbc2-af7f-4677-982e-62a46570734f service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Refreshing network info cache for port d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updated VIF entry in instance network info cache for port f446962d-48ce-4b5f-b105-d762c2338a0e. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [{"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-changed-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing instance network info cache due to event network-changed-2a858799-b2c0-421b-b998-8d229a9eb6d9. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing network info cache for port 2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-e127d1e4-489b-48e4-9975-f58c79658435 req-fc5cbbc2-af7f-4677-982e-62a46570734f service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updated VIF entry in instance network info cache for port d614c985-f857-4c70-8c85-978502f3d371. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-e127d1e4-489b-48e4-9975-f58c79658435 req-fc5cbbc2-af7f-4677-982e-62a46570734f service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e127d1e4-489b-48e4-9975-f58c79658435 req-fc5cbbc2-af7f-4677-982e-62a46570734f service nova] Releasing lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:35 user nova-compute[74638]: INFO nova.compute.manager [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] instance snapshotting
Nov 08 20:13:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Beginning live snapshot process
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updated VIF entry in instance network info cache for port 2a858799-b2c0-421b-b998-8d229a9eb6d9. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG nova.network.neutron [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [{"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ff5b31cb-c686-4077-94f7-82bb5f650f30 req-5689f6f2-f4ec-4e7a-a8ea-31438116bf0b service nova] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json -f qcow2 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json -f qcow2" returned: 0 in 0.227s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json -f qcow2 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfwvtkdd_/dc2e94d3f73e4d49a4ee8a69d179be68.delta 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfwvtkdd_/dc2e94d3f73e4d49a4ee8a69d179be68.delta 1073741824" returned: 0 in 0.052s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:36 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 20:13:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:13:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:13:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:13:37 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 20:13:38 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:13:38 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfwvtkdd_/dc2e94d3f73e4d49a4ee8a69d179be68.delta /opt/stack/data/nova/instances/snapshots/tmpfwvtkdd_/dc2e94d3f73e4d49a4ee8a69d179be68 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:38 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfwvtkdd_/dc2e94d3f73e4d49a4ee8a69d179be68.delta /opt/stack/data/nova/instances/snapshots/tmpfwvtkdd_/dc2e94d3f73e4d49a4ee8a69d179be68" returned: 0 in 0.583s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:38 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Snapshot extracted, beginning image upload
Nov 08 20:13:40 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f91c46b4-8ab6-4480-80e0-5e6df682e609 is timed out.
Nov 08 20:13:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully detached device vdb from instance f91c46b4-8ab6-4480-80e0-5e6df682e609 from the live domain config.
Nov 08 20:13:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXuNcYHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:13:40 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44af421-ea8c-488e-9819-b14521f185d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:13:40 user nova-compute[74638]: No targets found.
Nov 08 20:13:40 user nova-compute[74638]: iSNS:
Nov 08 20:13:40 user nova-compute[74638]: No targets found.
Nov 08 20:13:40 user nova-compute[74638]: STATIC:
Nov 08 20:13:40 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:13:40 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:13:40 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:13:40 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92
Nov 08 20:13:40 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:13:40 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:13:40 user nova-compute[74638]: FIRMWARE:
Nov 08 20:13:40 user nova-compute[74638]: No targets found.
Nov 08 20:13:40 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:13:40 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:13:40 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ce463-eb2b-4eb0-8362-1bae3ddba58f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[210fb364-ff34-4ea6-b16a-00aa9807ff7a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:13:40 user nova-compute[74638]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:13:40 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 (non-flash)
Nov 08 20:13:40 user nova-compute[74638]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:13:40 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c204af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e8fa6e-ccdf-41a8-928f-5cf2ced1d1e1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[96456e32-7120-461b-b426-a8bded0f56bb]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c00901-69a2-48e5-876c-866a3a05043f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c45a903-ff01-44a9-8273-3ea09f0718a6]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[81105bc0-bffe-422f-8189-f583db623d2f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b18f797-0dcb-4966-9f5b-6274b2fff562]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260]
Nov 08 20:13:40 user nova-compute[74638]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92, portal: 172.16.0.220,3260] successful.
Nov 08 20:13:40 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22b1bf19-c5b4-4f16-8acc-a26cc4177a92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0871d095-9bb5-4a7d-9d98-2773d044d112]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== disconnect_volume: return (333ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:13:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:13:41 user nova-compute[74638]: DEBUG nova.objects.instance [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:13:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-4700a743-f180-4b47-880d-eb85227e7ac0 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.261s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:13:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Snapshot image upload complete
Nov 08 20:13:42 user nova-compute[74638]: INFO nova.compute.manager [None req-bfa529cc-f3e1-45f4-a8ca-e0635d10cd5d tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Took 6.32 seconds to snapshot the instance on the hypervisor.
Nov 08 20:13:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f1af11e1-597f-43aa-95bc-cb54e9e42281 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f1af11e1-597f-43aa-95bc-cb54e9e42281 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f1af11e1-597f-43aa-95bc-cb54e9e42281 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f1af11e1-597f-43aa-95bc-cb54e9e42281 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74638) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f1af11e1-597f-43aa-95bc-cb54e9e42281 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-430f1b9a-7a2c-44c1-8d1b-665151af318d req-1f057807-6374-4c06-8d5b-36c0c1c7a23d service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-430f1b9a-7a2c-44c1-8d1b-665151af318d req-1f057807-6374-4c06-8d5b-36c0c1c7a23d service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:13:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-430f1b9a-7a2c-44c1-8d1b-665151af318d req-1f057807-6374-4c06-8d5b-36c0c1c7a23d service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:13:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-430f1b9a-7a2c-44c1-8d1b-665151af318d req-1f057807-6374-4c06-8d5b-36c0c1c7a23d service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:13:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-430f1b9a-7a2c-44c1-8d1b-665151af318d req-1f057807-6374-4c06-8d5b-36c0c1c7a23d service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:13:43 user nova-compute[74638]: WARNING nova.compute.manager [req-430f1b9a-7a2c-44c1-8d1b-665151af318d req-1f057807-6374-4c06-8d5b-36c0c1c7a23d service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state active and task_state powering-off.
Nov 08 20:13:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance destroyed successfully.
Nov 08 20:13:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f1af11e1-597f-43aa-95bc-cb54e9e42281 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:13:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f1af11e1-597f-43aa-95bc-cb54e9e42281 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.916s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:13:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-ffcae04b-bf3e-472f-b4d1-3a8d460760d6 req-3085081e-d618-4ed4-b34c-92b6975dbb3c service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:13:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ffcae04b-bf3e-472f-b4d1-3a8d460760d6 req-3085081e-d618-4ed4-b34c-92b6975dbb3c service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:13:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ffcae04b-bf3e-472f-b4d1-3a8d460760d6 req-3085081e-d618-4ed4-b34c-92b6975dbb3c service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:13:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ffcae04b-bf3e-472f-b4d1-3a8d460760d6 req-3085081e-d618-4ed4-b34c-92b6975dbb3c service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:13:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-ffcae04b-bf3e-472f-b4d1-3a8d460760d6 req-3085081e-d618-4ed4-b34c-92b6975dbb3c service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:13:45 user nova-compute[74638]: WARNING nova.compute.manager [req-ffcae04b-bf3e-472f-b4d1-3a8d460760d6 req-3085081e-d618-4ed4-b34c-92b6975dbb3c service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state stopped and task_state None.
Nov 08 20:13:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:48 user nova-compute[74638]: INFO nova.virt.block_device [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Booting with volume bb61b6ca-5b3a-4a86-bd71-284a179ca687 at /dev/vdb
Nov 08 20:13:48 user nova-compute[74638]: DEBUG os_brick.utils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe411f-bf7b-4127-964a-7fe42e147f37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc131c1-53ea-4c37-b822-40de69d7c974]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[089e74eb-33e9-40ba-ae4c-d9eb7b7008e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afd13a-0b15-4df8-bff8-c76b30f08549]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:13:48 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:13:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[17faa3c7-7d9c-4ebd-95c5-056a2d80c072]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG os_brick.utils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:13:48 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating existing volume attachment record: d4c952bc-b7ea-476b-8d95-c2d286bf9188 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:13:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:13:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:55 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:13:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Skipping network cache update for instance because it is Building. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid 07aab635-2120-4d29-8e6b-40a725ed8f37 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:13:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Updating instance_info_cache with network_info: [{"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-07aab635-2120-4d29-8e6b-40a725ed8f37" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:58 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:13:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:01 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:14:01 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:14:01 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=25.57776641845703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:14:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 10037bd1-d710-4ce1-abe8-b1f5b657c828 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a8f5663b-ac6f-4037-96c8-94152295e07e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 1953f44c-b839-4515-a0b4-1212bfa93092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 105b86cf-4f0f-4003-8407-42b945553b18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 58fede94-cddc-4a5c-b223-e1894250147e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:14:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:14:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-810899e8-7112-4e21-a6ff-12cb468eb37e req-7d235bfb-6848-412c-874e-cb6bb3d918be service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received event network-changed-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-810899e8-7112-4e21-a6ff-12cb468eb37e req-7d235bfb-6848-412c-874e-cb6bb3d918be service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Refreshing instance network info cache due to event network-changed-ac29bfff-79d2-42a9-99c4-8d7dce3705fc. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:14:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-810899e8-7112-4e21-a6ff-12cb468eb37e req-7d235bfb-6848-412c-874e-cb6bb3d918be service nova] Acquiring lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:14:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-810899e8-7112-4e21-a6ff-12cb468eb37e req-7d235bfb-6848-412c-874e-cb6bb3d918be service nova] Acquired lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:14:17 user nova-compute[74638]: DEBUG nova.network.neutron [req-810899e8-7112-4e21-a6ff-12cb468eb37e req-7d235bfb-6848-412c-874e-cb6bb3d918be service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Refreshing network info cache for port ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:14:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-810899e8-7112-4e21-a6ff-12cb468eb37e req-7d235bfb-6848-412c-874e-cb6bb3d918be service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updated VIF entry in instance network info cache for port ac29bfff-79d2-42a9-99c4-8d7dce3705fc. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:14:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-810899e8-7112-4e21-a6ff-12cb468eb37e req-7d235bfb-6848-412c-874e-cb6bb3d918be service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updating instance_info_cache with network_info: [{"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:14:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-810899e8-7112-4e21-a6ff-12cb468eb37e req-7d235bfb-6848-412c-874e-cb6bb3d918be service nova] Releasing lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:14:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG nova.objects.instance [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lazy-loading 'flavor' on Instance uuid 105b86cf-4f0f-4003-8407-42b945553b18 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:23 user nova-compute[74638]: INFO nova.compute.manager [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Attaching volume 0223cc51-37d4-439e-90c2-d2f235a6b317 to /dev/vdb
Nov 08 20:14:23 user nova-compute[74638]: DEBUG os_brick.utils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bce948a-b300-4104-866c-7c02e436517e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[288134fd-baff-4b34-9006-8fd81664c05a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cc4755-f0a4-4d4e-b56d-13682db61e52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c51a7f7-7d91-4a9d-9b7b-b9b8da88887a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:14:23 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:14:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a41019-38a7-4384-bd22-6ce9d57a6cb6]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG os_brick.utils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:14:23 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updating existing volume attachment record: abe636fc-437a-4e77-8569-ea0940ec05b8 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:24 user nova-compute[74638]: INFO nova.compute.manager [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Terminating instance
Nov 08 20:14:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9a92c54-2e5d-4933-a251-435f9720002b req-c5189ee1-5d0b-4c13-b0f7-b7e9550adedd service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received event network-vif-unplugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9a92c54-2e5d-4933-a251-435f9720002b req-c5189ee1-5d0b-4c13-b0f7-b7e9550adedd service nova] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9a92c54-2e5d-4933-a251-435f9720002b req-c5189ee1-5d0b-4c13-b0f7-b7e9550adedd service nova] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9a92c54-2e5d-4933-a251-435f9720002b req-c5189ee1-5d0b-4c13-b0f7-b7e9550adedd service nova] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9a92c54-2e5d-4933-a251-435f9720002b req-c5189ee1-5d0b-4c13-b0f7-b7e9550adedd service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] No waiting events found dispatching network-vif-unplugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9a92c54-2e5d-4933-a251-435f9720002b req-c5189ee1-5d0b-4c13-b0f7-b7e9550adedd service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received event network-vif-unplugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:14:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Instance destroyed successfully.
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lazy-loading 'resources' on Instance uuid 10037bd1-d710-4ce1-abe8-b1f5b657c828 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1387226148',display_name='tempest-ServerActionsTestOtherB-server-1387226148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1387226148',id=3,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNT8A1RgZiaKFum/883dNVq7J+v3UCm/3/JFR42J7y5Hebbohx5tb1NTPsX/lXcVvbFBbJq0a6gwWQrQVd1WQF6MRsP1YE0d59iTG4w3v32bGJ2E8n6PhHZjT/RrZMTOHQ==',key_name='tempest-keypair-1075117626',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da2cebdae35a49a7a6d6fbcf4b0cd1ee',ramdisk_id='',reservation_id='r-u0n8ymi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1698257018',owner_user_name='tempest-ServerActionsTestOtherB-1698257018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db7a353114a446b0a3294508e169cd3f',uuid=10037bd1-d710-4ce1-abe8-b1f5b657c828,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Converting VIF {"id": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "address": "fa:16:3e:32:38:bb", "network": {"id": "677302cb-0b2e-4e58-9adf-5e10929fa6fd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1113136906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da2cebdae35a49a7a6d6fbcf4b0cd1ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e07c583-ff", "ovs_interfaceid": "8e07c583-ff9b-4cd7-938e-d9464fa8b1b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:38:bb,bridge_name='br-int',has_traffic_filtering=True,id=8e07c583-ff9b-4cd7-938e-d9464fa8b1b8,network=Network(677302cb-0b2e-4e58-9adf-5e10929fa6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e07c583-ff') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG os_vif [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:38:bb,bridge_name='br-int',has_traffic_filtering=True,id=8e07c583-ff9b-4cd7-938e-d9464fa8b1b8,network=Network(677302cb-0b2e-4e58-9adf-5e10929fa6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e07c583-ff') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e07c583-ff, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0d89ccf-f436-4019-a29a-1a3af590681c) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:25 user nova-compute[74638]: INFO os_vif [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:38:bb,bridge_name='br-int',has_traffic_filtering=True,id=8e07c583-ff9b-4cd7-938e-d9464fa8b1b8,network=Network(677302cb-0b2e-4e58-9adf-5e10929fa6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e07c583-ff')
Nov 08 20:14:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Deleting instance files /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828_del
Nov 08 20:14:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Deletion of /opt/stack/data/nova/instances/10037bd1-d710-4ce1-abe8-b1f5b657c828_del complete
Nov 08 20:14:25 user nova-compute[74638]: INFO nova.compute.manager [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 20:14:25 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:14:25 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:14:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:26 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:14:26 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Took 1.31 seconds to deallocate network for instance.
Nov 08 20:14:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-392f24d0-f606-478c-8537-4c7a12adccd5 req-6ccf9e8f-dd01-4f68-86b4-17244ca04359 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received event network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-392f24d0-f606-478c-8537-4c7a12adccd5 req-6ccf9e8f-dd01-4f68-86b4-17244ca04359 service nova] Acquiring lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-392f24d0-f606-478c-8537-4c7a12adccd5 req-6ccf9e8f-dd01-4f68-86b4-17244ca04359 service nova] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-392f24d0-f606-478c-8537-4c7a12adccd5 req-6ccf9e8f-dd01-4f68-86b4-17244ca04359 service nova] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-392f24d0-f606-478c-8537-4c7a12adccd5 req-6ccf9e8f-dd01-4f68-86b4-17244ca04359 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] No waiting events found dispatching network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:14:27 user nova-compute[74638]: WARNING nova.compute.manager [req-392f24d0-f606-478c-8537-4c7a12adccd5 req-6ccf9e8f-dd01-4f68-86b4-17244ca04359 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received unexpected event network-vif-plugged-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 for instance with vm_state deleted and task_state None.
Nov 08 20:14:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-392f24d0-f606-478c-8537-4c7a12adccd5 req-6ccf9e8f-dd01-4f68-86b4-17244ca04359 service nova] [instance: 10037bd1-d710-4ce1-abe8-b1f5b657c828] Received event network-vif-deleted-8e07c583-ff9b-4cd7-938e-d9464fa8b1b8 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:14:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:27 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Deleted allocations for instance 10037bd1-d710-4ce1-abe8-b1f5b657c828
Nov 08 20:14:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ab43494b-1c85-4c8c-9b61-633c543a9e25 tempest-ServerActionsTestOtherB-1698257018 tempest-ServerActionsTestOtherB-1698257018-project-member] Lock "10037bd1-d710-4ce1-abe8-b1f5b657c828" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.942s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:14:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:14:40 user nova-compute[74638]: INFO nova.compute.claims [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Claim successful on node user
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "9f955212-6cf6-4f51-944a-5a3482082fda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.policy [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '444c578cebff4167825165a737b5bb85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f133d71d494371b87181e746074d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:14:41 user nova-compute[74638]: INFO nova.compute.claims [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Claim successful on node user
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:14:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Creating image(s)
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.216s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Successfully created port: 70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.242s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk 1073741824" returned: 0 in 0.062s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:14:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.280s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Checking if we can resize image /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.policy [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '444c578cebff4167825165a737b5bb85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f133d71d494371b87181e746074d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:14:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Creating image(s)
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Cannot resize image /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Ensure instance console log exists: /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.206s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Successfully updated port: 70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-e995afbb-1b17-419a-9953-07975840f11c req-42ea85bc-fbeb-4410-ab6d-626e6d3cf2ed service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-changed-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-e995afbb-1b17-419a-9953-07975840f11c req-42ea85bc-fbeb-4410-ab6d-626e6d3cf2ed service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Refreshing instance network info cache due to event network-changed-70d09fe3-1859-4697-bfcd-315471151873. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e995afbb-1b17-419a-9953-07975840f11c req-42ea85bc-fbeb-4410-ab6d-626e6d3cf2ed service nova] Acquiring lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e995afbb-1b17-419a-9953-07975840f11c req-42ea85bc-fbeb-4410-ab6d-626e6d3cf2ed service nova] Acquired lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-e995afbb-1b17-419a-9953-07975840f11c req-42ea85bc-fbeb-4410-ab6d-626e6d3cf2ed service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Refreshing network info cache for port 70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-e995afbb-1b17-419a-9953-07975840f11c req-42ea85bc-fbeb-4410-ab6d-626e6d3cf2ed service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.236s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk 1073741824" returned: 0 in 0.057s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-e995afbb-1b17-419a-9953-07975840f11c req-42ea85bc-fbeb-4410-ab6d-626e6d3cf2ed service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e995afbb-1b17-419a-9953-07975840f11c req-42ea85bc-fbeb-4410-ab6d-626e6d3cf2ed service nova] Releasing lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquired lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Successfully created port: d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Cannot resize image /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Ensure instance console log exists: /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updating instance_info_cache with network_info: [{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Releasing lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance network_info: |[{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Start _get_guest_xml network_info=[{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:14:43 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:14:43 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:14:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055513977',display_name='tempest-ServerRescueNegativeTestJSON-server-2055513977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055513977',id=18,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-0mocgist',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:14:42Z,user_data=None,user_id='444c578cebff4167825165a737b5bb85',uuid=862f8350-1466-4fec-b58b-2d7bd2ee8579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:8e:9d,bridge_name='br-int',has_traffic_filtering=True,id=70d09fe3-1859-4697-bfcd-315471151873,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d09fe3-18') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.objects.instance [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'pci_devices' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:14:44 user nova-compute[74638]:   <uuid>862f8350-1466-4fec-b58b-2d7bd2ee8579</uuid>
Nov 08 20:14:44 user nova-compute[74638]:   <name>instance-00000012</name>
Nov 08 20:14:44 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:14:44 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:14:44 user nova-compute[74638]:   <metadata>
Nov 08 20:14:44 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:14:44 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2055513977</nova:name>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:14:43</nova:creationTime>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:14:44 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:14:44 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:owner>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:user uuid="444c578cebff4167825165a737b5bb85">tempest-ServerRescueNegativeTestJSON-1603324862-project-member</nova:user>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:project uuid="e5f133d71d494371b87181e746074d70">tempest-ServerRescueNegativeTestJSON-1603324862</nova:project>
Nov 08 20:14:44 user nova-compute[74638]:       </nova:owner>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:ports>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:port uuid="70d09fe3-1859-4697-bfcd-315471151873">
Nov 08 20:14:44 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 20:14:44 user nova-compute[74638]:         </nova:port>
Nov 08 20:14:44 user nova-compute[74638]:       </nova:ports>
Nov 08 20:14:44 user nova-compute[74638]:     </nova:instance>
Nov 08 20:14:44 user nova-compute[74638]:   </metadata>
Nov 08 20:14:44 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:14:44 user nova-compute[74638]:     <system>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="serial">862f8350-1466-4fec-b58b-2d7bd2ee8579</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="uuid">862f8350-1466-4fec-b58b-2d7bd2ee8579</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:14:44 user nova-compute[74638]:     </system>
Nov 08 20:14:44 user nova-compute[74638]:   </sysinfo>
Nov 08 20:14:44 user nova-compute[74638]:   <os>
Nov 08 20:14:44 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:14:44 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:14:44 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:14:44 user nova-compute[74638]:   </os>
Nov 08 20:14:44 user nova-compute[74638]:   <features>
Nov 08 20:14:44 user nova-compute[74638]:     <acpi/>
Nov 08 20:14:44 user nova-compute[74638]:     <apic/>
Nov 08 20:14:44 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:14:44 user nova-compute[74638]:   </features>
Nov 08 20:14:44 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:14:44 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:14:44 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:14:44 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:14:44 user nova-compute[74638]:   </clock>
Nov 08 20:14:44 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:14:44 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:14:44 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:14:44 user nova-compute[74638]:   </cpu>
Nov 08 20:14:44 user nova-compute[74638]:   <devices>
Nov 08 20:14:44 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:14:44 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:14:44 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk"/>
Nov 08 20:14:44 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:14:44 user nova-compute[74638]:     </disk>
Nov 08 20:14:44 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:14:44 user nova-compute[74638]:       <mac address="fa:16:3e:33:8e:9d"/>
Nov 08 20:14:44 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:14:44 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:14:44 user nova-compute[74638]:       <target dev="tap70d09fe3-18"/>
Nov 08 20:14:44 user nova-compute[74638]:     </interface>
Nov 08 20:14:44 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:14:44 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/console.log" append="off"/>
Nov 08 20:14:44 user nova-compute[74638]:     </serial>
Nov 08 20:14:44 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:14:44 user nova-compute[74638]:     <video>
Nov 08 20:14:44 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:14:44 user nova-compute[74638]:     </video>
Nov 08 20:14:44 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:14:44 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:14:44 user nova-compute[74638]:     </rng>
Nov 08 20:14:44 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:14:44 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:14:44 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:14:44 user nova-compute[74638]:     </memballoon>
Nov 08 20:14:44 user nova-compute[74638]:   </devices>
Nov 08 20:14:44 user nova-compute[74638]: </domain>
Nov 08 20:14:44 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055513977',display_name='tempest-ServerRescueNegativeTestJSON-server-2055513977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055513977',id=18,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-0mocgist',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:14:42Z,user_data=None,user_id='444c578cebff4167825165a737b5bb85',uuid=862f8350-1466-4fec-b58b-2d7bd2ee8579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:8e:9d,bridge_name='br-int',has_traffic_filtering=True,id=70d09fe3-1859-4697-bfcd-315471151873,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d09fe3-18') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG os_vif [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:8e:9d,bridge_name='br-int',has_traffic_filtering=True,id=70d09fe3-1859-4697-bfcd-315471151873,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d09fe3-18') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c2c8213-e660-573e-b0a2-fdcd42796928', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d09fe3-18, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70d09fe3-18, col_values=(('qos', UUID('716d3917-a2f0-4e3c-b9e4-4ed97b632af2')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70d09fe3-18, col_values=(('external_ids', {'iface-id': '70d09fe3-1859-4697-bfcd-315471151873', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:8e:9d', 'vm-uuid': '862f8350-1466-4fec-b58b-2d7bd2ee8579'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: INFO os_vif [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:8e:9d,bridge_name='br-int',has_traffic_filtering=True,id=70d09fe3-1859-4697-bfcd-315471151873,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d09fe3-18')
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No VIF found with MAC fa:16:3e:33:8e:9d, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Successfully updated port: d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquired lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-69d964e7-0764-406a-9eb1-878c8f0a38ea req-2fa6fc3e-007d-4448-a2f7-e0278eefaaa2 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-changed-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-69d964e7-0764-406a-9eb1-878c8f0a38ea req-2fa6fc3e-007d-4448-a2f7-e0278eefaaa2 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Refreshing instance network info cache due to event network-changed-d23059b2-a4de-4b0f-8434-f4ff2e88f927. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-69d964e7-0764-406a-9eb1-878c8f0a38ea req-2fa6fc3e-007d-4448-a2f7-e0278eefaaa2 service nova] Acquiring lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updating instance_info_cache with network_info: [{"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Releasing lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Instance network_info: |[{"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-69d964e7-0764-406a-9eb1-878c8f0a38ea req-2fa6fc3e-007d-4448-a2f7-e0278eefaaa2 service nova] Acquired lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.neutron [req-69d964e7-0764-406a-9eb1-878c8f0a38ea req-2fa6fc3e-007d-4448-a2f7-e0278eefaaa2 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Refreshing network info cache for port d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Start _get_guest_xml network_info=[{"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:14:44 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:14:44 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-84924301',display_name='tempest-ServerRescueNegativeTestJSON-server-84924301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-84924301',id=19,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-kgkrpcj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:14:43Z,user_data=None,user_id='444c578cebff4167825165a737b5bb85',uuid=9f955212-6cf6-4f51-944a-5a3482082fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=d23059b2-a4de-4b0f-8434-f4ff2e88f927,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23059b2-a4') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.objects.instance [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:14:44 user nova-compute[74638]:   <uuid>9f955212-6cf6-4f51-944a-5a3482082fda</uuid>
Nov 08 20:14:44 user nova-compute[74638]:   <name>instance-00000013</name>
Nov 08 20:14:44 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:14:44 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:14:44 user nova-compute[74638]:   <metadata>
Nov 08 20:14:44 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:14:44 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-84924301</nova:name>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:14:44</nova:creationTime>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:14:44 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:14:44 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:owner>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:user uuid="444c578cebff4167825165a737b5bb85">tempest-ServerRescueNegativeTestJSON-1603324862-project-member</nova:user>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:project uuid="e5f133d71d494371b87181e746074d70">tempest-ServerRescueNegativeTestJSON-1603324862</nova:project>
Nov 08 20:14:44 user nova-compute[74638]:       </nova:owner>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:14:44 user nova-compute[74638]:       <nova:ports>
Nov 08 20:14:44 user nova-compute[74638]:         <nova:port uuid="d23059b2-a4de-4b0f-8434-f4ff2e88f927">
Nov 08 20:14:44 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 20:14:44 user nova-compute[74638]:         </nova:port>
Nov 08 20:14:44 user nova-compute[74638]:       </nova:ports>
Nov 08 20:14:44 user nova-compute[74638]:     </nova:instance>
Nov 08 20:14:44 user nova-compute[74638]:   </metadata>
Nov 08 20:14:44 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:14:44 user nova-compute[74638]:     <system>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="serial">9f955212-6cf6-4f51-944a-5a3482082fda</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="uuid">9f955212-6cf6-4f51-944a-5a3482082fda</entry>
Nov 08 20:14:44 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:14:44 user nova-compute[74638]:     </system>
Nov 08 20:14:44 user nova-compute[74638]:   </sysinfo>
Nov 08 20:14:44 user nova-compute[74638]:   <os>
Nov 08 20:14:44 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:14:44 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:14:44 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:14:44 user nova-compute[74638]:   </os>
Nov 08 20:14:44 user nova-compute[74638]:   <features>
Nov 08 20:14:44 user nova-compute[74638]:     <acpi/>
Nov 08 20:14:44 user nova-compute[74638]:     <apic/>
Nov 08 20:14:44 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:14:44 user nova-compute[74638]:   </features>
Nov 08 20:14:44 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:14:44 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:14:44 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:14:44 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:14:44 user nova-compute[74638]:   </clock>
Nov 08 20:14:44 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:14:44 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:14:44 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:14:44 user nova-compute[74638]:   </cpu>
Nov 08 20:14:44 user nova-compute[74638]:   <devices>
Nov 08 20:14:44 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:14:44 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:14:44 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk"/>
Nov 08 20:14:44 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:14:44 user nova-compute[74638]:     </disk>
Nov 08 20:14:44 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:14:44 user nova-compute[74638]:       <mac address="fa:16:3e:c4:59:0a"/>
Nov 08 20:14:44 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:14:44 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:14:44 user nova-compute[74638]:       <target dev="tapd23059b2-a4"/>
Nov 08 20:14:44 user nova-compute[74638]:     </interface>
Nov 08 20:14:44 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:14:44 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/console.log" append="off"/>
Nov 08 20:14:44 user nova-compute[74638]:     </serial>
Nov 08 20:14:44 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:14:44 user nova-compute[74638]:     <video>
Nov 08 20:14:44 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:14:44 user nova-compute[74638]:     </video>
Nov 08 20:14:44 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:14:44 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:14:44 user nova-compute[74638]:     </rng>
Nov 08 20:14:44 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:14:44 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:14:44 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:14:44 user nova-compute[74638]:     </memballoon>
Nov 08 20:14:44 user nova-compute[74638]:   </devices>
Nov 08 20:14:44 user nova-compute[74638]: </domain>
Nov 08 20:14:44 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-84924301',display_name='tempest-ServerRescueNegativeTestJSON-server-84924301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-84924301',id=19,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-kgkrpcj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:14:43Z,user_data=None,user_id='444c578cebff4167825165a737b5bb85',uuid=9f955212-6cf6-4f51-944a-5a3482082fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=d23059b2-a4de-4b0f-8434-f4ff2e88f927,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23059b2-a4') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG os_vif [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=d23059b2-a4de-4b0f-8434-f4ff2e88f927,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23059b2-a4') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d2b557d-13da-5711-8d17-31fd394ad364', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd23059b2-a4, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd23059b2-a4, col_values=(('qos', UUID('b5ad47b7-cbc5-47e7-826e-56c4e11b6a97')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd23059b2-a4, col_values=(('external_ids', {'iface-id': 'd23059b2-a4de-4b0f-8434-f4ff2e88f927', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:59:0a', 'vm-uuid': '9f955212-6cf6-4f51-944a-5a3482082fda'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:44 user nova-compute[74638]: INFO os_vif [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=d23059b2-a4de-4b0f-8434-f4ff2e88f927,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23059b2-a4')
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:14:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No VIF found with MAC fa:16:3e:c4:59:0a, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:14:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-69d964e7-0764-406a-9eb1-878c8f0a38ea req-2fa6fc3e-007d-4448-a2f7-e0278eefaaa2 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updated VIF entry in instance network info cache for port d23059b2-a4de-4b0f-8434-f4ff2e88f927. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:14:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-69d964e7-0764-406a-9eb1-878c8f0a38ea req-2fa6fc3e-007d-4448-a2f7-e0278eefaaa2 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updating instance_info_cache with network_info: [{"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:14:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-69d964e7-0764-406a-9eb1-878c8f0a38ea req-2fa6fc3e-007d-4448-a2f7-e0278eefaaa2 service nova] Releasing lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:14:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-a6865efb-afe7-496c-8ca1-14e4293012e4 req-9e366822-62da-4844-b397-0e7772d20861 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a6865efb-afe7-496c-8ca1-14e4293012e4 req-9e366822-62da-4844-b397-0e7772d20861 service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a6865efb-afe7-496c-8ca1-14e4293012e4 req-9e366822-62da-4844-b397-0e7772d20861 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a6865efb-afe7-496c-8ca1-14e4293012e4 req-9e366822-62da-4844-b397-0e7772d20861 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-a6865efb-afe7-496c-8ca1-14e4293012e4 req-9e366822-62da-4844-b397-0e7772d20861 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:14:47 user nova-compute[74638]: WARNING nova.compute.manager [req-a6865efb-afe7-496c-8ca1-14e4293012e4 req-9e366822-62da-4844-b397-0e7772d20861 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state building and task_state spawning.
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-422ce6ac-6d90-4a1a-bdaa-78105cdf3a51 req-7e9e12e0-a9fa-4673-a754-6c9f1ee37a5c service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-422ce6ac-6d90-4a1a-bdaa-78105cdf3a51 req-7e9e12e0-a9fa-4673-a754-6c9f1ee37a5c service nova] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-422ce6ac-6d90-4a1a-bdaa-78105cdf3a51 req-7e9e12e0-a9fa-4673-a754-6c9f1ee37a5c service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-422ce6ac-6d90-4a1a-bdaa-78105cdf3a51 req-7e9e12e0-a9fa-4673-a754-6c9f1ee37a5c service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-422ce6ac-6d90-4a1a-bdaa-78105cdf3a51 req-7e9e12e0-a9fa-4673-a754-6c9f1ee37a5c service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] No waiting events found dispatching network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:14:47 user nova-compute[74638]: WARNING nova.compute.manager [req-422ce6ac-6d90-4a1a-bdaa-78105cdf3a51 req-7e9e12e0-a9fa-4673-a754-6c9f1ee37a5c service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received unexpected event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 for instance with vm_state building and task_state spawning.
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-6d0c88ee-4b1b-4074-b411-1453ce753eca req-a556a637-09ae-4476-aea6-7e6b7d4e5afa service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6d0c88ee-4b1b-4074-b411-1453ce753eca req-a556a637-09ae-4476-aea6-7e6b7d4e5afa service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6d0c88ee-4b1b-4074-b411-1453ce753eca req-a556a637-09ae-4476-aea6-7e6b7d4e5afa service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6d0c88ee-4b1b-4074-b411-1453ce753eca req-a556a637-09ae-4476-aea6-7e6b7d4e5afa service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-6d0c88ee-4b1b-4074-b411-1453ce753eca req-a556a637-09ae-4476-aea6-7e6b7d4e5afa service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:14:49 user nova-compute[74638]: WARNING nova.compute.manager [req-6d0c88ee-4b1b-4074-b411-1453ce753eca req-a556a637-09ae-4476-aea6-7e6b7d4e5afa service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state building and task_state spawning.
Nov 08 20:14:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2fdedf3d-4f71-4a87-9bfc-f11d3e2f977a req-f17e44da-dfec-4917-91f8-6ef7c152d55c service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2fdedf3d-4f71-4a87-9bfc-f11d3e2f977a req-f17e44da-dfec-4917-91f8-6ef7c152d55c service nova] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2fdedf3d-4f71-4a87-9bfc-f11d3e2f977a req-f17e44da-dfec-4917-91f8-6ef7c152d55c service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2fdedf3d-4f71-4a87-9bfc-f11d3e2f977a req-f17e44da-dfec-4917-91f8-6ef7c152d55c service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2fdedf3d-4f71-4a87-9bfc-f11d3e2f977a req-f17e44da-dfec-4917-91f8-6ef7c152d55c service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] No waiting events found dispatching network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:14:49 user nova-compute[74638]: WARNING nova.compute.manager [req-2fdedf3d-4f71-4a87-9bfc-f11d3e2f977a req-f17e44da-dfec-4917-91f8-6ef7c152d55c service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received unexpected event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 for instance with vm_state building and task_state spawning.
Nov 08 20:14:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:14:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance spawned successfully.
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:14:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Instance spawned successfully.
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:14:50 user nova-compute[74638]: INFO nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:14:50 user nova-compute[74638]: INFO nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Took 8.43 seconds to spawn the instance on the hypervisor.
Nov 08 20:14:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:14:50 user nova-compute[74638]: INFO nova.compute.manager [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Took 8.64 seconds to build instance.
Nov 08 20:14:50 user nova-compute[74638]: INFO nova.compute.manager [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Took 9.37 seconds to build instance.
Nov 08 20:14:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922a29ca-6b80-400b-a75f-6c8c3ff2ef0d tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "9f955212-6cf6-4f51-944a-5a3482082fda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.835s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-758a67f4-f75f-450f-a4f6-7e4846dd9f96 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.632s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXaPNvuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:14:52 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:14:52 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:14:52 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f09531-7f88-4669-954b-1ac9d84ae3c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:14:52 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[137b7763-da90-44a6-a4ee-bae0131030a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317] added
Nov 08 20:14:52 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[473c2073-c475-48b8-b450-7afd2e002362]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[41650bc1-278a-4dd4-b6f6-cceb8bd65660]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXaPNvuo {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXaPNvuo" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27147a7-7b5b-4007-b40d-65a7183c05f5]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jXaPNvuo'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9bc675-0f02-4126-a9f9-1fa2a8f16320]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f87cb-e1dd-4092-b465-fd13b727ff2c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:14:52 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:14:52 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c935ba-6434-4f67-882a-9b7c4a475f0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317, portal: 172.16.0.220,3260]
Nov 08 20:14:52 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317, portal: 172.16.0.220,3260] successful.
Nov 08 20:14:52 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc85c67-7228-4d60-bda2-42b3dba8bcc1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c429bd8-e5bb-4fd0-8d5d-d903c5b1b0b4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:14:52 user nova-compute[74638]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 (non-flash)
Nov 08 20:14:52 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:14:52 user nova-compute[74638]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 (non-flash)
Nov 08 20:14:52 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfb457f-0726-4ad2-a8ea-d7df40141a62]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:14:52 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXaPNvuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:14:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:14:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23561383632316436', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:14:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561383632316436', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:14:53 user nova-compute[74638]: DEBUG nova.objects.instance [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lazy-loading 'flavor' on Instance uuid 105b86cf-4f0f-4003-8407-42b945553b18 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:14:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:14:53 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:14:53 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:14:53 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:14:53 user nova-compute[74638]:   <serial>0223cc51-37d4-439e-90c2-d2f235a6b317</serial>
Nov 08 20:14:53 user nova-compute[74638]: </disk>
Nov 08 20:14:53 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:14:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:14:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:14:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] No VIF found with MAC fa:16:3e:eb:23:b7, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:14:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d1d34bc1-e38f-49d8-afc3-ef3a1a7c9e88 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.592s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:14:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:14:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:14:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:14:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:14:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:14:56 user nova-compute[74638]: INFO nova.compute.manager [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Detaching volume 0223cc51-37d4-439e-90c2-d2f235a6b317
Nov 08 20:14:56 user nova-compute[74638]: INFO nova.virt.block_device [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Attempting to driver detach volume 0223cc51-37d4-439e-90c2-d2f235a6b317 from mountpoint /dev/vdb
Nov 08 20:14:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Attempting to detach device vdb from instance 105b86cf-4f0f-4003-8407-42b945553b18 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:14:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:14:56 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:14:56 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:14:56 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:14:56 user nova-compute[74638]:   <serial>0223cc51-37d4-439e-90c2-d2f235a6b317</serial>
Nov 08 20:14:56 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:14:56 user nova-compute[74638]: </disk>
Nov 08 20:14:56 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:14:56 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Successfully detached device vdb from instance 105b86cf-4f0f-4003-8407-42b945553b18 from the persistent domain config.
Nov 08 20:14:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 105b86cf-4f0f-4003-8407-42b945553b18 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:14:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:14:56 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:14:56 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:14:56 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:14:56 user nova-compute[74638]:   <serial>0223cc51-37d4-439e-90c2-d2f235a6b317</serial>
Nov 08 20:14:56 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:14:56 user nova-compute[74638]: </disk>
Nov 08 20:14:56 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:14:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:14:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:14:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 105b86cf-4f0f-4003-8407-42b945553b18 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:14:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:14:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:14:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:14:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:14:57 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:14:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating instance_info_cache with network_info: [{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:14:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:14:58 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:14:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:14:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:14:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:14:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:00 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:15:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:01 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:05 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:15:05 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7881MB free_disk=25.572635650634766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a8f5663b-ac6f-4037-96c8-94152295e07e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 1953f44c-b839-4515-a0b4-1212bfa93092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 105b86cf-4f0f-4003-8407-42b945553b18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 58fede94-cddc-4a5c-b223-e1894250147e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:15:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:13 user nova-compute[74638]: INFO nova.compute.manager [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Detaching volume 879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:15:13 user nova-compute[74638]: INFO nova.virt.block_device [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Attempting to driver detach volume 879763b7-beb0-41a3-93e2-0f8b3388f126 from mountpoint /dev/vdb
Nov 08 20:15:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Attempting to detach device vdb from instance a8f5663b-ac6f-4037-96c8-94152295e07e from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:15:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:15:13 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:15:13 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:15:13 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:15:13 user nova-compute[74638]:   <serial>879763b7-beb0-41a3-93e2-0f8b3388f126</serial>
Nov 08 20:15:13 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 20:15:13 user nova-compute[74638]: </disk>
Nov 08 20:15:13 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:15:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully detached device vdb from instance a8f5663b-ac6f-4037-96c8-94152295e07e from the persistent domain config.
Nov 08 20:15:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8f5663b-ac6f-4037-96c8-94152295e07e from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:15:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:15:13 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:15:13 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:15:13 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:15:13 user nova-compute[74638]:   <serial>879763b7-beb0-41a3-93e2-0f8b3388f126</serial>
Nov 08 20:15:13 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 20:15:13 user nova-compute[74638]: </disk>
Nov 08 20:15:13 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:15:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8f5663b-ac6f-4037-96c8-94152295e07e {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:15:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:16 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 105b86cf-4f0f-4003-8407-42b945553b18 is timed out.
Nov 08 20:15:16 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Successfully detached device vdb from instance 105b86cf-4f0f-4003-8407-42b945553b18 from the live domain config.
Nov 08 20:15:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXaPNvuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:15:16 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:15:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf9dd72-7438-4f8d-a0e8-28aac8956ca6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:15:16 user nova-compute[74638]: No targets found.
Nov 08 20:15:16 user nova-compute[74638]: iSNS:
Nov 08 20:15:16 user nova-compute[74638]: No targets found.
Nov 08 20:15:16 user nova-compute[74638]: STATIC:
Nov 08 20:15:16 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:15:16 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:15:16 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:15:16 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317
Nov 08 20:15:16 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:15:16 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:15:16 user nova-compute[74638]: FIRMWARE:
Nov 08 20:15:16 user nova-compute[74638]: No targets found.
Nov 08 20:15:16 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:15:16 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:15:16 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:15:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b01a4f-6fb5-44ae-a194-85cf73d9689f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50594f3-fc91-4569-9497-6976f51269cc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:15:17 user nova-compute[74638]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 (non-flash)
Nov 08 20:15:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:15:17 user nova-compute[74638]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 (non-flash)
Nov 08 20:15:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3801f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8b8fc-d6d6-441c-afc7-078f3f5ea2f2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f2e00-8c91-4ed8-9c5b-f3038dd6ce27]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8939eb3d-b5a8-493d-9f11-e17caf80a0f5]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aeb8a2-57d8-4bfc-a519-beee17c71ca2]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1609f0f-78ae-4ef5-b43c-ca4be269d93f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1701db97-cb99-4586-afa1-c1fc54a6c7de]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317, portal: 172.16.0.220,3260]
Nov 08 20:15:17 user nova-compute[74638]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317, portal: 172.16.0.220,3260] successful.
Nov 08 20:15:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223cc51-37d4-439e-90c2-d2f235a6b317 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dea9b6-05f0-4e67-a790-f895d2dc2ade]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] <== disconnect_volume: return (291ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:15:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:15:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:18 user nova-compute[74638]: DEBUG nova.objects.instance [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lazy-loading 'flavor' on Instance uuid 105b86cf-4f0f-4003-8407-42b945553b18 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81329115-a7d3-4450-b6b2-302e431c7411 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.030s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'flavor' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:27 user nova-compute[74638]: INFO nova.compute.manager [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Attaching volume 37b60297-5e78-4627-bc71-24a98e393066 to /dev/vdb
Nov 08 20:15:27 user nova-compute[74638]: DEBUG os_brick.utils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b7f606-e768-439d-b652-c8da56ecae98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e79a44-6814-4b7d-ae10-9bec0003474f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a5d7dc-1190-464e-b044-3b72862c6f55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e35edf-d254-4b36-ab75-f8e827c8f66d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:15:27 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:15:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b1d7bf-00a0-4163-b92c-6ec150651c56]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG os_brick.utils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:15:27 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating existing volume attachment record: a66e4648-7cef-46ff-bcb3-ba4b9044c745 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:15:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:15:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquired lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:15:33 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:15:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'info_cache' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating instance_info_cache with network_info: [{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Releasing lock "refresh_cache-f91c46b4-8ab6-4480-80e0-5e6df682e609" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:15:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance destroyed successfully.
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'resources' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.base [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_vif [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dae479f-02, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26f98926-15b8-4eb8-842f-d79cfb426d1a) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:34 user nova-compute[74638]: INFO os_vif [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02')
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Start _get_guest_xml network_info=[{"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'numa_topology' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.base [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:15:34 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:15:34 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'vcpu_model' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.base [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'pci_devices' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.base [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:15:34 user nova-compute[74638]:   <uuid>f91c46b4-8ab6-4480-80e0-5e6df682e609</uuid>
Nov 08 20:15:34 user nova-compute[74638]:   <name>instance-00000004</name>
Nov 08 20:15:34 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:15:34 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:15:34 user nova-compute[74638]:   <metadata>
Nov 08 20:15:34 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:15:34 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:15:34 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeTestJSON-server-1261014533</nova:name>
Nov 08 20:15:34 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:15:34</nova:creationTime>
Nov 08 20:15:34 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:15:34 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:15:34 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:15:34 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:15:34 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:15:34 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:15:34 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:15:34 user nova-compute[74638]:       <nova:owner>
Nov 08 20:15:34 user nova-compute[74638]:         <nova:user uuid="b75bc3e9142b4bf6a314dc12b7a42bbe">tempest-AttachVolumeTestJSON-1773867302-project-member</nova:user>
Nov 08 20:15:34 user nova-compute[74638]:         <nova:project uuid="3b6b297f1c394c5d84966b543d7a9cc6">tempest-AttachVolumeTestJSON-1773867302</nova:project>
Nov 08 20:15:34 user nova-compute[74638]:       </nova:owner>
Nov 08 20:15:34 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:15:34 user nova-compute[74638]:       <nova:ports>
Nov 08 20:15:34 user nova-compute[74638]:         <nova:port uuid="2dae479f-02ee-40bc-8a5d-436e3931e032">
Nov 08 20:15:34 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 20:15:34 user nova-compute[74638]:         </nova:port>
Nov 08 20:15:34 user nova-compute[74638]:       </nova:ports>
Nov 08 20:15:34 user nova-compute[74638]:     </nova:instance>
Nov 08 20:15:34 user nova-compute[74638]:   </metadata>
Nov 08 20:15:34 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:15:34 user nova-compute[74638]:     <system>
Nov 08 20:15:34 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:15:34 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:15:34 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:15:34 user nova-compute[74638]:       <entry name="serial">f91c46b4-8ab6-4480-80e0-5e6df682e609</entry>
Nov 08 20:15:34 user nova-compute[74638]:       <entry name="uuid">f91c46b4-8ab6-4480-80e0-5e6df682e609</entry>
Nov 08 20:15:34 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:15:34 user nova-compute[74638]:     </system>
Nov 08 20:15:34 user nova-compute[74638]:   </sysinfo>
Nov 08 20:15:34 user nova-compute[74638]:   <os>
Nov 08 20:15:34 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:15:34 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:15:34 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:15:34 user nova-compute[74638]:   </os>
Nov 08 20:15:34 user nova-compute[74638]:   <features>
Nov 08 20:15:34 user nova-compute[74638]:     <acpi/>
Nov 08 20:15:34 user nova-compute[74638]:     <apic/>
Nov 08 20:15:34 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:15:34 user nova-compute[74638]:   </features>
Nov 08 20:15:34 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:15:34 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:15:34 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:15:34 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:15:34 user nova-compute[74638]:   </clock>
Nov 08 20:15:34 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:15:34 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:15:34 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:15:34 user nova-compute[74638]:   </cpu>
Nov 08 20:15:34 user nova-compute[74638]:   <devices>
Nov 08 20:15:34 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:15:34 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:15:34 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk"/>
Nov 08 20:15:34 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:15:34 user nova-compute[74638]:     </disk>
Nov 08 20:15:34 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:15:34 user nova-compute[74638]:       <mac address="fa:16:3e:32:99:5e"/>
Nov 08 20:15:34 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:15:34 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:15:34 user nova-compute[74638]:       <target dev="tap2dae479f-02"/>
Nov 08 20:15:34 user nova-compute[74638]:     </interface>
Nov 08 20:15:34 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:15:34 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/console.log" append="off"/>
Nov 08 20:15:34 user nova-compute[74638]:     </serial>
Nov 08 20:15:34 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:15:34 user nova-compute[74638]:     <video>
Nov 08 20:15:34 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:15:34 user nova-compute[74638]:     </video>
Nov 08 20:15:34 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:15:34 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:15:34 user nova-compute[74638]:     </rng>
Nov 08 20:15:34 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:15:34 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:15:34 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:15:34 user nova-compute[74638]:     </memballoon>
Nov 08 20:15:34 user nova-compute[74638]:   </devices>
Nov 08 20:15:34 user nova-compute[74638]: </domain>
Nov 08 20:15:34 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8f5663b-ac6f-4037-96c8-94152295e07e is timed out.
Nov 08 20:15:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully detached device vdb from instance a8f5663b-ac6f-4037-96c8-94152295e07e from the live domain config.
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOrkFjpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:15:34 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22e746e-125a-49c8-b25f-6201bf8d6f89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:15:34 user nova-compute[74638]: No targets found.
Nov 08 20:15:34 user nova-compute[74638]: iSNS:
Nov 08 20:15:34 user nova-compute[74638]: No targets found.
Nov 08 20:15:34 user nova-compute[74638]: STATIC:
Nov 08 20:15:34 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126
Nov 08 20:15:34 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:15:34 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:15:34 user nova-compute[74638]: FIRMWARE:
Nov 08 20:15:34 user nova-compute[74638]: No targets found.
Nov 08 20:15:34 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:15:34 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:15:34 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[98628a7f-9c7d-4cff-92c9-643edd62a69d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[22479d48-536c-4207-9f9c-462b9b1ec07f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:15:34 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 (non-flash)
Nov 08 20:15:34 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3fc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[da84addf-daa8-4193-b66b-c04c3c011f33]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[935088dc-e5ba-4045-b4e9-77a0d5906528]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ee7bf-7b96-4fcf-9b42-18c6d9345f3f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[94880708-c1cc-4ef2-98c8-283e097dc47e]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d970c5f-5f79-4486-bf99-6a6efcb8ee82]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'trusted_certs' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d94a53a-9b72-4954-bc02-c5c3a58c98ab]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260]
Nov 08 20:15:34 user nova-compute[74638]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126, portal: 172.16.0.220,3260] successful.
Nov 08 20:15:34 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.objects.base [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:879763b7-beb0-41a3-93e2-0f8b3388f126 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b425b57-3e93-4338-87f7-2def38d0a0d4]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== disconnect_volume: return (382ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:15:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Cannot resize image /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'migration_context' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG nova.objects.base [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Object Instance<f91c46b4-8ab6-4480-80e0-5e6df682e609> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG os_vif [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab8e4e0d-31a7-57ab-ac3a-c74f60ba0660', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dae479f-02, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dae479f-02, col_values=(('qos', UUID('54c22424-d4a3-4070-8538-4f4b50c82644')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dae479f-02, col_values=(('external_ids', {'iface-id': '2dae479f-02ee-40bc-8a5d-436e3931e032', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:99:5e', 'vm-uuid': 'f91c46b4-8ab6-4480-80e0-5e6df682e609'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:35 user nova-compute[74638]: INFO os_vif [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02')
Nov 08 20:15:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'flavor' on Instance uuid a8f5663b-ac6f-4037-96c8-94152295e07e {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-833a07ab-3c13-4fd1-b776-45f1142e254c tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.098s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:36 user nova-compute[74638]: INFO nova.virt.block_device [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Booting with volume c53f8771-4bc3-48d9-b55d-e81c59676278 at /dev/vdc
Nov 08 20:15:36 user nova-compute[74638]: DEBUG os_brick.utils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829bde7-0304-44f0-81c5-7040bcdf286b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[351ce209-75ea-4052-9e37-0729cf8afebf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f14d38-4849-4439-9e1e-ffa28bece89e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[75499ece-2e86-47d7-a451-6ad53897337a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:15:36 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b04a8-b25f-463e-9082-def86022ecc4]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG os_brick.utils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating existing volume attachment record: afbd66fd-f79b-4728-8079-89e7541a6bc0 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-9e93b6dd-1536-4031-b3b1-00b6efbe34ef req-abbaef9d-4a25-4ddf-8d72-dfc3d265b98f service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9e93b6dd-1536-4031-b3b1-00b6efbe34ef req-abbaef9d-4a25-4ddf-8d72-dfc3d265b98f service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9e93b6dd-1536-4031-b3b1-00b6efbe34ef req-abbaef9d-4a25-4ddf-8d72-dfc3d265b98f service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9e93b6dd-1536-4031-b3b1-00b6efbe34ef req-abbaef9d-4a25-4ddf-8d72-dfc3d265b98f service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-9e93b6dd-1536-4031-b3b1-00b6efbe34ef req-abbaef9d-4a25-4ddf-8d72-dfc3d265b98f service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:15:36 user nova-compute[74638]: WARNING nova.compute.manager [req-9e93b6dd-1536-4031-b3b1-00b6efbe34ef req-abbaef9d-4a25-4ddf-8d72-dfc3d265b98f service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state stopped and task_state powering-on.
Nov 08 20:15:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:38 user nova-compute[74638]: DEBUG nova.compute.manager [req-2120a815-c000-40fd-880e-0351fff6543c req-baed627a-6e83-4777-b35d-7d10efe73e83 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:15:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2120a815-c000-40fd-880e-0351fff6543c req-baed627a-6e83-4777-b35d-7d10efe73e83 service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2120a815-c000-40fd-880e-0351fff6543c req-baed627a-6e83-4777-b35d-7d10efe73e83 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2120a815-c000-40fd-880e-0351fff6543c req-baed627a-6e83-4777-b35d-7d10efe73e83 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:38 user nova-compute[74638]: DEBUG nova.compute.manager [req-2120a815-c000-40fd-880e-0351fff6543c req-baed627a-6e83-4777-b35d-7d10efe73e83 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:15:38 user nova-compute[74638]: WARNING nova.compute.manager [req-2120a815-c000-40fd-880e-0351fff6543c req-baed627a-6e83-4777-b35d-7d10efe73e83 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state stopped and task_state powering-on.
Nov 08 20:15:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:15:38 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance rebooted successfully.
Nov 08 20:15:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0d58d520-0814-48fe-a37f-5a7cd86b2aaf tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:15:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "61243e09-42f2-4c57-8426-5aa54e0ad99a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:15:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:48 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:15:48 user nova-compute[74638]: INFO nova.compute.claims [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Claim successful on node user
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.network.neutron [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:15:49 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.policy [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa581d9fbb664526bfabb540888b2779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d8305b8bf4f3c8083aabe8768c906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:15:49 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Creating image(s)
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "/opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "/opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "/opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk 1073741824" returned: 0 in 0.068s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Cannot resize image /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Ensure instance console log exists: /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Successfully created port: 4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Successfully updated port: 4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "refresh_cache-61243e09-42f2-4c57-8426-5aa54e0ad99a" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquired lock "refresh_cache-61243e09-42f2-4c57-8426-5aa54e0ad99a" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-e33d8696-ee05-4575-b9b7-0dfe840ba1be req-c3203167-4eb3-499d-98c5-3bd3b6b29131 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received event network-changed-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-e33d8696-ee05-4575-b9b7-0dfe840ba1be req-c3203167-4eb3-499d-98c5-3bd3b6b29131 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Refreshing instance network info cache due to event network-changed-4f8220ef-e09d-4236-82f0-9996f4313d85. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e33d8696-ee05-4575-b9b7-0dfe840ba1be req-c3203167-4eb3-499d-98c5-3bd3b6b29131 service nova] Acquiring lock "refresh_cache-61243e09-42f2-4c57-8426-5aa54e0ad99a" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Updating instance_info_cache with network_info: [{"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Releasing lock "refresh_cache-61243e09-42f2-4c57-8426-5aa54e0ad99a" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Instance network_info: |[{"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e33d8696-ee05-4575-b9b7-0dfe840ba1be req-c3203167-4eb3-499d-98c5-3bd3b6b29131 service nova] Acquired lock "refresh_cache-61243e09-42f2-4c57-8426-5aa54e0ad99a" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.network.neutron [req-e33d8696-ee05-4575-b9b7-0dfe840ba1be req-c3203167-4eb3-499d-98c5-3bd3b6b29131 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Refreshing network info cache for port 4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Start _get_guest_xml network_info=[{"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:15:51 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:15:51 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1235473174',display_name='tempest-VolumesAdminNegativeTest-server-1235473174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1235473174',id=20,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335d8305b8bf4f3c8083aabe8768c906',ramdisk_id='',reservation_id='r-xl3vxyaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1731747303',owner_user_name='tempest-VolumesAdminNegativeTest-1731747303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:15:49Z,user_data=None,user_id='fa581d9fbb664526bfabb540888b2779',uuid=61243e09-42f2-4c57-8426-5aa54e0ad99a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converting VIF {"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:fb,bridge_name='br-int',has_traffic_filtering=True,id=4f8220ef-e09d-4236-82f0-9996f4313d85,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8220ef-e0') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.objects.instance [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lazy-loading 'pci_devices' on Instance uuid 61243e09-42f2-4c57-8426-5aa54e0ad99a {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:15:51 user nova-compute[74638]:   <uuid>61243e09-42f2-4c57-8426-5aa54e0ad99a</uuid>
Nov 08 20:15:51 user nova-compute[74638]:   <name>instance-00000014</name>
Nov 08 20:15:51 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:15:51 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:15:51 user nova-compute[74638]:   <metadata>
Nov 08 20:15:51 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:15:51 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:15:51 user nova-compute[74638]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1235473174</nova:name>
Nov 08 20:15:51 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:15:51</nova:creationTime>
Nov 08 20:15:51 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:15:51 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:15:51 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:15:51 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:15:51 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:15:51 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:15:51 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:15:51 user nova-compute[74638]:       <nova:owner>
Nov 08 20:15:51 user nova-compute[74638]:         <nova:user uuid="fa581d9fbb664526bfabb540888b2779">tempest-VolumesAdminNegativeTest-1731747303-project-member</nova:user>
Nov 08 20:15:51 user nova-compute[74638]:         <nova:project uuid="335d8305b8bf4f3c8083aabe8768c906">tempest-VolumesAdminNegativeTest-1731747303</nova:project>
Nov 08 20:15:51 user nova-compute[74638]:       </nova:owner>
Nov 08 20:15:51 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:15:51 user nova-compute[74638]:       <nova:ports>
Nov 08 20:15:51 user nova-compute[74638]:         <nova:port uuid="4f8220ef-e09d-4236-82f0-9996f4313d85">
Nov 08 20:15:51 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 20:15:51 user nova-compute[74638]:         </nova:port>
Nov 08 20:15:51 user nova-compute[74638]:       </nova:ports>
Nov 08 20:15:51 user nova-compute[74638]:     </nova:instance>
Nov 08 20:15:51 user nova-compute[74638]:   </metadata>
Nov 08 20:15:51 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:15:51 user nova-compute[74638]:     <system>
Nov 08 20:15:51 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:15:51 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:15:51 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:15:51 user nova-compute[74638]:       <entry name="serial">61243e09-42f2-4c57-8426-5aa54e0ad99a</entry>
Nov 08 20:15:51 user nova-compute[74638]:       <entry name="uuid">61243e09-42f2-4c57-8426-5aa54e0ad99a</entry>
Nov 08 20:15:51 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:15:51 user nova-compute[74638]:     </system>
Nov 08 20:15:51 user nova-compute[74638]:   </sysinfo>
Nov 08 20:15:51 user nova-compute[74638]:   <os>
Nov 08 20:15:51 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:15:51 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:15:51 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:15:51 user nova-compute[74638]:   </os>
Nov 08 20:15:51 user nova-compute[74638]:   <features>
Nov 08 20:15:51 user nova-compute[74638]:     <acpi/>
Nov 08 20:15:51 user nova-compute[74638]:     <apic/>
Nov 08 20:15:51 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:15:51 user nova-compute[74638]:   </features>
Nov 08 20:15:51 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:15:51 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:15:51 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:15:51 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:15:51 user nova-compute[74638]:   </clock>
Nov 08 20:15:51 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:15:51 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:15:51 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:15:51 user nova-compute[74638]:   </cpu>
Nov 08 20:15:51 user nova-compute[74638]:   <devices>
Nov 08 20:15:51 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:15:51 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:15:51 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk"/>
Nov 08 20:15:51 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:15:51 user nova-compute[74638]:     </disk>
Nov 08 20:15:51 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:15:51 user nova-compute[74638]:       <mac address="fa:16:3e:e3:2c:fb"/>
Nov 08 20:15:51 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:15:51 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:15:51 user nova-compute[74638]:       <target dev="tap4f8220ef-e0"/>
Nov 08 20:15:51 user nova-compute[74638]:     </interface>
Nov 08 20:15:51 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:15:51 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/console.log" append="off"/>
Nov 08 20:15:51 user nova-compute[74638]:     </serial>
Nov 08 20:15:51 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:15:51 user nova-compute[74638]:     <video>
Nov 08 20:15:51 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:15:51 user nova-compute[74638]:     </video>
Nov 08 20:15:51 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:15:51 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:15:51 user nova-compute[74638]:     </rng>
Nov 08 20:15:51 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:15:51 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:15:51 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:15:51 user nova-compute[74638]:     </memballoon>
Nov 08 20:15:51 user nova-compute[74638]:   </devices>
Nov 08 20:15:51 user nova-compute[74638]: </domain>
Nov 08 20:15:51 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1235473174',display_name='tempest-VolumesAdminNegativeTest-server-1235473174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1235473174',id=20,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335d8305b8bf4f3c8083aabe8768c906',ramdisk_id='',reservation_id='r-xl3vxyaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1731747303',owner_user_name='tempest-VolumesAdminNegativeTest-1731747303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:15:49Z,user_data=None,user_id='fa581d9fbb664526bfabb540888b2779',uuid=61243e09-42f2-4c57-8426-5aa54e0ad99a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converting VIF {"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:fb,bridge_name='br-int',has_traffic_filtering=True,id=4f8220ef-e09d-4236-82f0-9996f4313d85,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8220ef-e0') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG os_vif [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:fb,bridge_name='br-int',has_traffic_filtering=True,id=4f8220ef-e09d-4236-82f0-9996f4313d85,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8220ef-e0') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32d18877-9c19-5934-b827-9d8d8c703add', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f8220ef-e0, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f8220ef-e0, col_values=(('qos', UUID('7a0174a9-6063-4e94-9aad-6e0599d9b470')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f8220ef-e0, col_values=(('external_ids', {'iface-id': '4f8220ef-e09d-4236-82f0-9996f4313d85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:2c:fb', 'vm-uuid': '61243e09-42f2-4c57-8426-5aa54e0ad99a'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:52 user nova-compute[74638]: INFO os_vif [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:fb,bridge_name='br-int',has_traffic_filtering=True,id=4f8220ef-e09d-4236-82f0-9996f4313d85,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8220ef-e0')
Nov 08 20:15:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] No VIF found with MAC fa:16:3e:e3:2c:fb, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-e33d8696-ee05-4575-b9b7-0dfe840ba1be req-c3203167-4eb3-499d-98c5-3bd3b6b29131 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Updated VIF entry in instance network info cache for port 4f8220ef-e09d-4236-82f0-9996f4313d85. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-e33d8696-ee05-4575-b9b7-0dfe840ba1be req-c3203167-4eb3-499d-98c5-3bd3b6b29131 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Updating instance_info_cache with network_info: [{"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:15:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e33d8696-ee05-4575-b9b7-0dfe840ba1be req-c3203167-4eb3-499d-98c5-3bd3b6b29131 service nova] Releasing lock "refresh_cache-61243e09-42f2-4c57-8426-5aa54e0ad99a" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:15:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a4fdd00-0923-4e85-a206-77265fbfb470 req-085bdce3-4d62-402a-bb96-0acf5e2d0ad5 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received event network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:15:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a4fdd00-0923-4e85-a206-77265fbfb470 req-085bdce3-4d62-402a-bb96-0acf5e2d0ad5 service nova] Acquiring lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a4fdd00-0923-4e85-a206-77265fbfb470 req-085bdce3-4d62-402a-bb96-0acf5e2d0ad5 service nova] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5a4fdd00-0923-4e85-a206-77265fbfb470 req-085bdce3-4d62-402a-bb96-0acf5e2d0ad5 service nova] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a4fdd00-0923-4e85-a206-77265fbfb470 req-085bdce3-4d62-402a-bb96-0acf5e2d0ad5 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] No waiting events found dispatching network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:15:54 user nova-compute[74638]: WARNING nova.compute.manager [req-5a4fdd00-0923-4e85-a206-77265fbfb470 req-085bdce3-4d62-402a-bb96-0acf5e2d0ad5 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received unexpected event network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 for instance with vm_state building and task_state spawning.
Nov 08 20:15:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTrIklyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:15:55 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:15:55 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:15:55 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9291b97b-3fea-486e-a13d-f678b26b7469]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:15:55 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef13c099-d688-42b8-9314-114b91b526ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066] added
Nov 08 20:15:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1bb3c3-8cd9-40bd-adbf-b2b77a5d3c77]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94ed5a9-c371-4f5e-bbf3-43abeb78d40f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTrIklyq {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTrIklyq" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca23d0c-2f54-4484-b759-fd6b1e2eb462]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FTrIklyq'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872500d-3a2b-4383-b6a3-7d0904e90108]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee52341-bfc3-4e4f-bb59-e5604ef5a969]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:15:55 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:15:55 user nova-compute[74638]:  {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:15:55 user nova-compute[74638]: WARNING os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 20:15:55 user nova-compute[74638]: 
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84a2bd3-4d18-41d2-a863-b7454497b212]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066, portal: 172.16.0.220,3260]
Nov 08 20:15:55 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066, portal: 172.16.0.220,3260] successful.
Nov 08 20:15:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a3bfca-f431-4fcb-b6be-fa0f240037c8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6215fad-5f69-497f-b99a-4f7038f6ec56]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:15:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:15:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a953c2aa-53bd-4874-994c-efcbdba8bb3f]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:15:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-22851cbd-3f3d-4ecf-bf85-4fe19808241b req-cb4b367f-3007-4d67-8a68-6aafa6a07772 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received event network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22851cbd-3f3d-4ecf-bf85-4fe19808241b req-cb4b367f-3007-4d67-8a68-6aafa6a07772 service nova] Acquiring lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22851cbd-3f3d-4ecf-bf85-4fe19808241b req-cb4b367f-3007-4d67-8a68-6aafa6a07772 service nova] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22851cbd-3f3d-4ecf-bf85-4fe19808241b req-cb4b367f-3007-4d67-8a68-6aafa6a07772 service nova] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-22851cbd-3f3d-4ecf-bf85-4fe19808241b req-cb4b367f-3007-4d67-8a68-6aafa6a07772 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] No waiting events found dispatching network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:15:56 user nova-compute[74638]: WARNING nova.compute.manager [req-22851cbd-3f3d-4ecf-bf85-4fe19808241b req-cb4b367f-3007-4d67-8a68-6aafa6a07772 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received unexpected event network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 for instance with vm_state building and task_state spawning.
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:15:56 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Instance spawned successfully.
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:15:56 user nova-compute[74638]: INFO nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Took 7.21 seconds to spawn the instance on the hypervisor.
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTrIklyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23763643565363661', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763643565363661', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'flavor' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:15:56 user nova-compute[74638]: INFO nova.compute.manager [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Took 8.19 seconds to build instance.
Nov 08 20:15:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d53a3739-c3bf-425a-b0d2-4fd6c1ea1236 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.320s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:15:56 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:15:56 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:15:56 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:15:56 user nova-compute[74638]:   <serial>37b60297-5e78-4627-bc71-24a98e393066</serial>
Nov 08 20:15:56 user nova-compute[74638]: </disk>
Nov 08 20:15:56 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:15:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:15:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:15:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No VIF found with MAC fa:16:3e:f3:99:b0, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:15:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2b864cf-7f17-4276-95bf-0d1789a79a81 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.438s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:15:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:15:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:58 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:15:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:15:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:15:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:15:59 user nova-compute[74638]: INFO nova.compute.manager [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Rescuing
Nov 08 20:15:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquired lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG nova.network.neutron [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:15:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG nova.network.neutron [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Releasing lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-6942faae-fa92-434e-89a2-e60073655d66 req-cf3621d8-6224-49a3-8f8b-215a51173612 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6942faae-fa92-434e-89a2-e60073655d66 req-cf3621d8-6224-49a3-8f8b-215a51173612 service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6942faae-fa92-434e-89a2-e60073655d66 req-cf3621d8-6224-49a3-8f8b-215a51173612 service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6942faae-fa92-434e-89a2-e60073655d66 req-cf3621d8-6224-49a3-8f8b-215a51173612 service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-6942faae-fa92-434e-89a2-e60073655d66 req-cf3621d8-6224-49a3-8f8b-215a51173612 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:00 user nova-compute[74638]: WARNING nova.compute.manager [req-6942faae-fa92-434e-89a2-e60073655d66 req-cf3621d8-6224-49a3-8f8b-215a51173612 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state active and task_state rescuing.
Nov 08 20:16:01 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance destroyed successfully.
Nov 08 20:16:01 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Attempting a stable device rescue
Nov 08 20:16:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74638) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 20:16:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance directory exists: not creating {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 20:16:01 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Creating image(s)
Nov 08 20:16:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:01 user nova-compute[74638]: DEBUG nova.objects.instance [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "17723cbacd0297de00c17c0e4792abf2a9426859" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "17723cbacd0297de00c17c0e4792abf2a9426859" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG nova.compute.manager [req-0c540aa9-3a79-4f9f-9597-3b8c87cbb08f req-cc463c6f-3bf5-41a2-be42-e552dd790cec service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0c540aa9-3a79-4f9f-9597-3b8c87cbb08f req-cc463c6f-3bf5-41a2-be42-e552dd790cec service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0c540aa9-3a79-4f9f-9597-3b8c87cbb08f req-cc463c6f-3bf5-41a2-be42-e552dd790cec service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0c540aa9-3a79-4f9f-9597-3b8c87cbb08f req-cc463c6f-3bf5-41a2-be42-e552dd790cec service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG nova.compute.manager [req-0c540aa9-3a79-4f9f-9597-3b8c87cbb08f req-cc463c6f-3bf5-41a2-be42-e552dd790cec service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:02 user nova-compute[74638]: WARNING nova.compute.manager [req-0c540aa9-3a79-4f9f-9597-3b8c87cbb08f req-cc463c6f-3bf5-41a2-be42-e552dd790cec service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state active and task_state rescuing.
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859.part --force-share --output=json" returned: 0 in 0.249s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG nova.virt.images [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] 0a0e632e-6829-4cd0-afd9-ce2135bc17ea was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859.part /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859.part /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859.converted" returned: 0 in 0.528s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "17723cbacd0297de00c17c0e4792abf2a9426859" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.399s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "17723cbacd0297de00c17c0e4792abf2a9426859" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "17723cbacd0297de00c17c0e4792abf2a9426859" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859 --force-share --output=json" returned: 0 in 0.208s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859,backing_fmt=raw /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.rescue {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859,backing_fmt=raw /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.rescue" returned: 0 in 0.065s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "17723cbacd0297de00c17c0e4792abf2a9426859" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.objects.instance [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'migration_context' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.objects.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Object Instance<1953f44c-b839-4515-a0b4-1212bfa93092> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Start _get_guest_xml network_info=[{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "vif_mac": "fa:16:3e:f3:99:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0a0e632e-6829-4cd0-afd9-ce2135bc17ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'a66e4648-7cef-46ff-bcb3-ba4b9044c745', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTrIklyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1953f44c-b839-4515-a0b4-1212bfa93092', 'attached_at': '', 'detached_at': '', 'volume_id': '37b60297-5e78-4627-bc71-24a98e393066', 'serial': '37b60297-5e78-4627-bc71-24a98e393066'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.objects.instance [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'resources' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.objects.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Object Instance<1953f44c-b839-4515-a0b4-1212bfa93092> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.objects.instance [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'numa_topology' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG nova.objects.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Object Instance<1953f44c-b839-4515-a0b4-1212bfa93092> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:03 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:16:03 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.objects.instance [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.objects.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Object Instance<1953f44c-b839-4515-a0b4-1212bfa93092> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTrIklyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:16:04 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:16:04 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:16:04 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6ecb89-f25f-44fd-83d6-859b4f46a91f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FTrIklyq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 20:16:04 user nova-compute[74638]: node.name = iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066
Nov 08 20:16:04 user nova-compute[74638]: node.tpgt = -1
Nov 08 20:16:04 user nova-compute[74638]: node.startup = automatic
Nov 08 20:16:04 user nova-compute[74638]: node.leading_login = No
Nov 08 20:16:04 user nova-compute[74638]: iface.iscsi_ifacename = default
Nov 08 20:16:04 user nova-compute[74638]: iface.net_ifacename = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.ipaddress = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.prefix_len = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.hwaddress = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.transport_name = tcp
Nov 08 20:16:04 user nova-compute[74638]: iface.initiatorname = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.state = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.vlan_id = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.vlan_priority = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.vlan_state = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.iface_num = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.mtu = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.port = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.bootproto = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.subnet_mask = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.gateway = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.dhcp_alt_client_id = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.dhcp_dns = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.dhcp_learn_iqn = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.dhcp_vendor_id_state = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.dhcp_vendor_id = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.dhcp_slp_da = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.fragmentation = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.gratuitous_arp = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.incoming_forwarding = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.tos_state = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.tos = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.ttl = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.delayed_ack = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.tcp_nagle = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.tcp_wsf_state = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.tcp_wsf = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.tcp_timer_scale = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.tcp_timestamp = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.redirect = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.def_task_mgmt_timeout = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.header_digest = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.data_digest = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.immediate_data = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.initial_r2t = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.data_seq_inorder = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.data_pdu_inorder = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.erl = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.max_receive_data_len = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.first_burst_len = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.max_outstanding_r2t = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.max_burst_len = 0
Nov 08 20:16:04 user nova-compute[74638]: iface.chap_auth = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.bidi_chap = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.strict_login_compliance = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.discovery_auth = <empty>
Nov 08 20:16:04 user nova-compute[74638]: iface.discovery_logout = <empty>
Nov 08 20:16:04 user nova-compute[74638]: node.discovery_address = <empty>
Nov 08 20:16:04 user nova-compute[74638]: node.discovery_port = 0
Nov 08 20:16:04 user nova-compute[74638]: node.discovery_type = static
Nov 08 20:16:04 user nova-compute[74638]: node.session.initial_cmdsn = 0
Nov 08 20:16:04 user nova-compute[74638]: node.session.initial_login_retry_max = 8
Nov 08 20:16:04 user nova-compute[74638]: node.session.xmit_thread_priority = -20
Nov 08 20:16:04 user nova-compute[74638]: node.session.cmds_max = 128
Nov 08 20:16:04 user nova-compute[74638]: node.session.queue_depth = 32
Nov 08 20:16:04 user nova-compute[74638]: node.session.nr_sessions = 1
Nov 08 20:16:04 user nova-compute[74638]: node.session.auth.authmethod = CHAP
Nov 08 20:16:04 user nova-compute[74638]: node.session.auth.username = FTrIklyq
Nov 08 20:16:04 user nova-compute[74638]: node.session.auth.password = ***
Nov 08 20:16:04 user nova-compute[74638]: node.session.auth.username_in = <empty>
Nov 08 20:16:04 user nova-compute[74638]: node.session.auth.password_in = <empty>
Nov 08 20:16:04 user nova-compute[74638]: node.session.auth.chap_algs = MD5
Nov 08 20:16:04 user nova-compute[74638]: node.session.timeo.replacement_timeout = 120
Nov 08 20:16:04 user nova-compute[74638]: node.session.err_timeo.abort_timeout = 15
Nov 08 20:16:04 user nova-compute[74638]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 20:16:04 user nova-compute[74638]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 20:16:04 user nova-compute[74638]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.FastAbort = Yes
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.InitialR2T = No
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.ImmediateData = Yes
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.MaxConnections = 1
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 20:16:04 user nova-compute[74638]: node.session.iscsi.ERL = 0
Nov 08 20:16:04 user nova-compute[74638]: node.session.scan = manual
Nov 08 20:16:04 user nova-compute[74638]: node.session.reopen_max = 0
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].address = 172.16.0.220
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].port = 3260
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].startup = manual
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].tcp.window_size = 524288
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].tcp.type_of_service = 0
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].timeo.logout_timeout = 15
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].timeo.login_timeout = 15
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].timeo.auth_timeout = 45
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].iscsi.DataDigest = None
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].iscsi.IFMarker = No
Nov 08 20:16:04 user nova-compute[74638]: node.conn[0].iscsi.OFMarker = No
Nov 08 20:16:04 user nova-compute[74638]: # END RECORD
Nov 08 20:16:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:04 user nova-compute[74638]: INFO nova.compute.manager [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Terminating instance
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd684b94-e5f3-4eca-9fe1-f67acd501ca4]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae34b839-aaba-4dbd-aa48-9a5f5ab35cf8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTrIklyq {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTrIklyq" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9c3c50-7dc2-4b2b-9f4c-12a83cbe3570]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FTrIklyq'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcae8811-0f69-4b49-bfe4-6591bde643b1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca5c3e-1ac4-4fde-b4ce-9a14e614b239]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:04 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] HCTL ('33', '0', '0', 0) found on session 18 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f3a27f-79d0-4620-8bd1-0408eff1afb9]: (4, ('0 0 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Searching for a device in session 18 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTrIklyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.280s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] <== connect_volume: return (282ms) {'type': 'block', 'scsi_wwn': '23763643565363661', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763643565363661', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1737635490',display_name='tempest-ServerStableDeviceRescueTest-server-1737635490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1737635490',id=14,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv4BzGaDlMkGHGGrY4jSpEJ98U9jM3DTJwijs+luNH2DEebNfGrXkT4dqtpf/34BQk/mDcg+JeXTkYG/MiMXBYflJK97osFRYFp77MZm/WNRrQ9XpFvvMRDzoYfdjmvHA==',key_name='tempest-keypair-1947903140',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d043fa01edf445d7800d8769c42679b0',ramdisk_id='',reservation_id='r-i7fdsk39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1632952037',owner_user_name='tempest-ServerStableDeviceRescueTest-1632952037-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b8fcd95c5640fe844391a748962632',uuid=1953f44c-b839-4515-a0b4-1212bfa93092,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "vif_mac": "fa:16:3e:f3:99:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Converting VIF {"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "vif_mac": "fa:16:3e:f3:99:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=d614c985-f857-4c70-8c85-978502f3d371,network=Network(dcda2602-3545-4300-b633-881db1a6c3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd614c985-f8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.objects.instance [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'pci_devices' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.objects.base [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Object Instance<1953f44c-b839-4515-a0b4-1212bfa93092> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:16:04 user nova-compute[74638]:   <uuid>1953f44c-b839-4515-a0b4-1212bfa93092</uuid>
Nov 08 20:16:04 user nova-compute[74638]:   <name>instance-0000000e</name>
Nov 08 20:16:04 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:16:04 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:16:04 user nova-compute[74638]:   <metadata>
Nov 08 20:16:04 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:16:04 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:16:04 user nova-compute[74638]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1737635490</nova:name>
Nov 08 20:16:04 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:16:03</nova:creationTime>
Nov 08 20:16:04 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:16:04 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:16:04 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:16:04 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:16:04 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:16:04 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:16:04 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:16:04 user nova-compute[74638]:       <nova:owner>
Nov 08 20:16:04 user nova-compute[74638]:         <nova:user uuid="16b8fcd95c5640fe844391a748962632">tempest-ServerStableDeviceRescueTest-1632952037-project-member</nova:user>
Nov 08 20:16:04 user nova-compute[74638]:         <nova:project uuid="d043fa01edf445d7800d8769c42679b0">tempest-ServerStableDeviceRescueTest-1632952037</nova:project>
Nov 08 20:16:04 user nova-compute[74638]:       </nova:owner>
Nov 08 20:16:04 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:16:04 user nova-compute[74638]:       <nova:ports>
Nov 08 20:16:04 user nova-compute[74638]:         <nova:port uuid="d614c985-f857-4c70-8c85-978502f3d371">
Nov 08 20:16:04 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 20:16:04 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:04 user nova-compute[74638]:       </nova:ports>
Nov 08 20:16:04 user nova-compute[74638]:     </nova:instance>
Nov 08 20:16:04 user nova-compute[74638]:   </metadata>
Nov 08 20:16:04 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:16:04 user nova-compute[74638]:     <system>
Nov 08 20:16:04 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:16:04 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:16:04 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:16:04 user nova-compute[74638]:       <entry name="serial">1953f44c-b839-4515-a0b4-1212bfa93092</entry>
Nov 08 20:16:04 user nova-compute[74638]:       <entry name="uuid">1953f44c-b839-4515-a0b4-1212bfa93092</entry>
Nov 08 20:16:04 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:16:04 user nova-compute[74638]:     </system>
Nov 08 20:16:04 user nova-compute[74638]:   </sysinfo>
Nov 08 20:16:04 user nova-compute[74638]:   <os>
Nov 08 20:16:04 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:16:04 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:16:04 user nova-compute[74638]:   </os>
Nov 08 20:16:04 user nova-compute[74638]:   <features>
Nov 08 20:16:04 user nova-compute[74638]:     <acpi/>
Nov 08 20:16:04 user nova-compute[74638]:     <apic/>
Nov 08 20:16:04 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:16:04 user nova-compute[74638]:   </features>
Nov 08 20:16:04 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:16:04 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:16:04 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:16:04 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:16:04 user nova-compute[74638]:   </clock>
Nov 08 20:16:04 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:16:04 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:16:04 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:16:04 user nova-compute[74638]:   </cpu>
Nov 08 20:16:04 user nova-compute[74638]:   <devices>
Nov 08 20:16:04 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:16:04 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:16:04 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk"/>
Nov 08 20:16:04 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:16:04 user nova-compute[74638]:     </disk>
Nov 08 20:16:04 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:16:04 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:16:04 user nova-compute[74638]:       <source dev="/dev/sdb"/>
Nov 08 20:16:04 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:16:04 user nova-compute[74638]:       <serial>37b60297-5e78-4627-bc71-24a98e393066</serial>
Nov 08 20:16:04 user nova-compute[74638]:     </disk>
Nov 08 20:16:04 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:16:04 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:16:04 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.rescue"/>
Nov 08 20:16:04 user nova-compute[74638]:       <target dev="vdc" bus="virtio"/>
Nov 08 20:16:04 user nova-compute[74638]:       <boot order="1"/>
Nov 08 20:16:04 user nova-compute[74638]:     </disk>
Nov 08 20:16:04 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:04 user nova-compute[74638]:       <mac address="fa:16:3e:f3:99:b0"/>
Nov 08 20:16:04 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:04 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:04 user nova-compute[74638]:       <target dev="tapd614c985-f8"/>
Nov 08 20:16:04 user nova-compute[74638]:     </interface>
Nov 08 20:16:04 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:16:04 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/console.log" append="off"/>
Nov 08 20:16:04 user nova-compute[74638]:     </serial>
Nov 08 20:16:04 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:16:04 user nova-compute[74638]:     <video>
Nov 08 20:16:04 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:04 user nova-compute[74638]:     </video>
Nov 08 20:16:04 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:16:04 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:16:04 user nova-compute[74638]:     </rng>
Nov 08 20:16:04 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:16:04 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:16:04 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:16:04 user nova-compute[74638]:     </memballoon>
Nov 08 20:16:04 user nova-compute[74638]:   </devices>
Nov 08 20:16:04 user nova-compute[74638]: </domain>
Nov 08 20:16:04 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8499441-cc27-4e1b-8422-984fc820e9d8 req-323d93d4-def3-4674-9847-0899da6efadd service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8499441-cc27-4e1b-8422-984fc820e9d8 req-323d93d4-def3-4674-9847-0899da6efadd service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8499441-cc27-4e1b-8422-984fc820e9d8 req-323d93d4-def3-4674-9847-0899da6efadd service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8499441-cc27-4e1b-8422-984fc820e9d8 req-323d93d4-def3-4674-9847-0899da6efadd service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8499441-cc27-4e1b-8422-984fc820e9d8 req-323d93d4-def3-4674-9847-0899da6efadd service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8499441-cc27-4e1b-8422-984fc820e9d8 req-323d93d4-def3-4674-9847-0899da6efadd service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:16:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance destroyed successfully.
Nov 08 20:16:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] No VIF found with MAC fa:16:3e:f3:99:b0, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Instance destroyed successfully.
Nov 08 20:16:05 user nova-compute[74638]: DEBUG nova.objects.instance [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'resources' on Instance uuid a8f5663b-ac6f-4037-96c8-94152295e07e {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:09:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-116077949',display_name='tempest-ServerActionsTestOtherA-server-1716522574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-116077949',id=13,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPi+eiPDqr6HlSxIQXH10Azfpx5sZFk+jXLb7JAwxAhz2gsJtoPLkM7/afKnSfkwD64rnPqNXm5hNSYOOnXFXGL2P8MItyH/1MyEiogdDVC1Nfak4q9GTrUuVYpG2ko6aA==',key_name='tempest-keypair-253147816',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:12:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-wsqgnlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=a8f5663b-ac6f-4037-96c8-94152295e07e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "address": "fa:16:3e:63:61:cb", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36206fb4-fe", "ovs_interfaceid": "36206fb4-fe9a-400f-90ff-cc2657e78bda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG os_vif [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36206fb4-fe, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4384f975-15ae-49a7-a3aa-d66d7b1b1dec) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: INFO os_vif [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:61:cb,bridge_name='br-int',has_traffic_filtering=True,id=36206fb4-fe9a-400f-90ff-cc2657e78bda,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36206fb4-fe')
Nov 08 20:16:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Deleting instance files /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e_del
Nov 08 20:16:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Deletion of /opt/stack/data/nova/instances/a8f5663b-ac6f-4037-96c8-94152295e07e_del complete
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:05 user nova-compute[74638]: INFO nova.compute.manager [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:16:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Creating image(s)
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Ensure instance console log exists: /opt/stack/data/nova/instances/58fede94-cddc-4a5c-b223-e1894250147e/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Start _get_guest_xml network_info=[{"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '93e6cc51-b643-4d9c-8742-d3d5058dd14f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AIZGVHRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58fede94-cddc-4a5c-b223-e1894250147e', 'attached_at': '', 'detached_at': '', 'volume_id': '809f9f7e-7770-419e-b371-d843ec0e2ccb', 'serial': '809f9f7e-7770-419e-b371-d843ec0e2ccb'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'd4c952bc-b7ea-476b-8d95-c2d286bf9188', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpICbLRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58fede94-cddc-4a5c-b223-e1894250147e', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb61b6ca-5b3a-4a86-bd71-284a179ca687', 'serial': 'bb61b6ca-5b3a-4a86-bd71-284a179ca687'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'afbd66fd-f79b-4728-8079-89e7541a6bc0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbsxQmKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58fede94-cddc-4a5c-b223-e1894250147e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c53f8771-4bc3-48d9-b55d-e81c59676278', 'serial': 'c53f8771-4bc3-48d9-b55d-e81c59676278'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:16:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AIZGVHRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:16:06 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:16:06 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:16:06 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fdfd4f-5624-4bfb-8f84-676656127f99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:16:06 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab060159-e140-47a5-87f5-d682a8ef87e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb] added
Nov 08 20:16:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac580775-bbd1-447c-894e-1fd54c740169]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a354f78-e2e7-4045-b49b-72d70eb36d4d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AIZGVHRJ {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AIZGVHRJ" returned: 0 in 0.063s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1a404b-1391-48e3-bbf9-90af936f7c3d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AIZGVHRJ'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa7d4df-da18-4846-9981-0c5428623ec7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:06 user nova-compute[74638]: WARNING nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state active and task_state deleting.
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:06 user nova-compute[74638]: WARNING nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state active and task_state deleting.
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:06 user nova-compute[74638]: WARNING nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state active and task_state deleting.
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-unplugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Acquiring lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] No waiting events found dispatching network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:06 user nova-compute[74638]: WARNING nova.compute.manager [req-3ff86dd0-c5a8-4a9b-91dd-a17f866ed3c2 req-acf00945-b053-42c8-828c-cf9e0fc6c666 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received unexpected event network-vif-plugged-36206fb4-fe9a-400f-90ff-cc2657e78bda for instance with vm_state active and task_state deleting.
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c5f27-c2c7-4be3-8736-f36218fbcc96]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --login" returned: 0 in 0.146s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb04b33-ad76-4d22-85bf-605d31651675]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb, portal: 172.16.0.220,3260]
Nov 08 20:16:06 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb, portal: 172.16.0.220,3260] successful.
Nov 08 20:16:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-f0184cee-b528-47a6-9be8-ec4ad978d172 req-d1a54532-37c5-4f23-a0a8-c3d82d071de7 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Received event network-vif-deleted-36206fb4-fe9a-400f-90ff-cc2657e78bda {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:06 user nova-compute[74638]: INFO nova.compute.manager [req-f0184cee-b528-47a6-9be8-ec4ad978d172 req-d1a54532-37c5-4f23-a0a8-c3d82d071de7 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Neutron deleted interface 36206fb4-fe9a-400f-90ff-cc2657e78bda; detaching it from the instance and deleting it from the info cache
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-f0184cee-b528-47a6-9be8-ec4ad978d172 req-d1a54532-37c5-4f23-a0a8-c3d82d071de7 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:16:06 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Took 1.22 seconds to deallocate network for instance.
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7584e489-d93d-47bc-b211-f40311500aeb]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-f0184cee-b528-47a6-9be8-ec4ad978d172 req-d1a54532-37c5-4f23-a0a8-c3d82d071de7 service nova] [instance: a8f5663b-ac6f-4037-96c8-94152295e07e] Detach interface failed, port_id=36206fb4-fe9a-400f-90ff-cc2657e78bda, reason: Instance a8f5663b-ac6f-4037-96c8-94152295e07e could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[22151ec7-1ddd-4325-a529-8f353221e7ca]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:06 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:06 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.659s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b60e4e-f67a-4d4f-ad87-3504ff7d197f]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AIZGVHRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-0cee946d-1871-4f6b-b83e-7fb102676f09 req-ecdc1a40-1fd8-4133-a25f-960092b391b2 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0cee946d-1871-4f6b-b83e-7fb102676f09 req-ecdc1a40-1fd8-4133-a25f-960092b391b2 service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0cee946d-1871-4f6b-b83e-7fb102676f09 req-ecdc1a40-1fd8-4133-a25f-960092b391b2 service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0cee946d-1871-4f6b-b83e-7fb102676f09 req-ecdc1a40-1fd8-4133-a25f-960092b391b2 service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-0cee946d-1871-4f6b-b83e-7fb102676f09 req-ecdc1a40-1fd8-4133-a25f-960092b391b2 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:07 user nova-compute[74638]: WARNING nova.compute.manager [req-0cee946d-1871-4f6b-b83e-7fb102676f09 req-ecdc1a40-1fd8-4133-a25f-960092b391b2 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state active and task_state rescuing.
Nov 08 20:16:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.149s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== connect_volume: return (3151ms) {'type': 'block', 'scsi_wwn': '23430376264633237', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430376264633237', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-493f178f-35fb-4997-9746-3d358df8943e tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-b993d4f7-613a-4f0c-b845-cdd4e121faf6 req-e76f1733-c0ee-46ac-afb0-4006c23839ee service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b993d4f7-613a-4f0c-b845-cdd4e121faf6 req-e76f1733-c0ee-46ac-afb0-4006c23839ee service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b993d4f7-613a-4f0c-b845-cdd4e121faf6 req-e76f1733-c0ee-46ac-afb0-4006c23839ee service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b993d4f7-613a-4f0c-b845-cdd4e121faf6 req-e76f1733-c0ee-46ac-afb0-4006c23839ee service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-b993d4f7-613a-4f0c-b845-cdd4e121faf6 req-e76f1733-c0ee-46ac-afb0-4006c23839ee service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:09 user nova-compute[74638]: WARNING nova.compute.manager [req-b993d4f7-613a-4f0c-b845-cdd4e121faf6 req-e76f1733-c0ee-46ac-afb0-4006c23839ee service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state active and task_state rescuing.
Nov 08 20:16:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:16:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7777MB free_disk=25.404708862304688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpICbLRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:16:09 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:16:09 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:16:09 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e771edb-af56-4790-ac78-9b35dc6c8cca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:16:09 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7249cb3-f3eb-4f12-90ba-7bb8ad980f6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687] added
Nov 08 20:16:09 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebab69f-334e-42b1-985a-be15298783d7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[956cf71e-51cc-4ca7-a8bc-f17184650d12]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpICbLRc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpICbLRc" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d93757-6263-49ec-8ed1-f0357eb32989]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XpICbLRc'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e06711-ab22-4a50-8e8b-97b7fa878e7b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[04276e4a-4057-4071-b247-1a8153913e14]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:09 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:09 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:09 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:09 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.703s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.286s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ebe1d-9a54-467b-8698-fb31a3e21028]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687, portal: 172.16.0.220,3260]
Nov 08 20:16:09 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687, portal: 172.16.0.220,3260] successful.
Nov 08 20:16:09 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:09 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Deleted allocations for instance a8f5663b-ac6f-4037-96c8-94152295e07e
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1720f139-b9c2-404a-96e3-a19184c60cb8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7160edc5-852d-4415-a559-efeef6cf2cbd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:09 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:09 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:16:09 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:09 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:09 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:16:09 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d38b1e8-7d41-4f37-ab63-2ded3694f5ce]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07aab635-2120-4d29-8e6b-40a725ed8f37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 1953f44c-b839-4515-a0b4-1212bfa93092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 105b86cf-4f0f-4003-8407-42b945553b18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 58fede94-cddc-4a5c-b223-e1894250147e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 61243e09-42f2-4c57-8426-5aa54e0ad99a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:16:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-00532ad4-0aeb-404f-8846-153c06a58ab3 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "a8f5663b-ac6f-4037-96c8-94152295e07e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.775s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpICbLRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23731613338626638', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:16:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731613338626638', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbsxQmKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:16:11 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:16:11 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:16:11 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb899d6e-c59d-48d0-971c-f0d10005da5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:16:11 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a837fc67-3db9-45b6-8c0d-c4e0c0907f74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278] added
Nov 08 20:16:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5fca1c-d179-4031-bc5c-d6f06a72ee10]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1eb80a-d6de-486d-a622-61bdfeb7845b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JbsxQmKz {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JbsxQmKz" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a618d7-f82b-4541-9d8d-8ef3b81b1b8d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JbsxQmKz'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f71efa-8175-4599-ad19-cabc702b9222]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[17900004-d218-4d78-98b5-e3c99ca8c445]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[659d26f2-daba-499e-adf7-b806add9be87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278, portal: 172.16.0.220,3260]
Nov 08 20:16:11 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278, portal: 172.16.0.220,3260] successful.
Nov 08 20:16:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f63b8e4-1bf9-4c74-a168-09dc811b78a3]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[812d466c-f2df-427d-b985-0279cfa424d3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)
Nov 08 20:16:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cae6bd-d28d-4d18-9978-9ad6c14764b2]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:16:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbsxQmKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26530633339663863', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530633339663863', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=e2bfa746-5623-4be5-a820-87dcf5200be7,network=Network(fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfa746-56') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6c:18,bridge_name='br-int',has_traffic_filtering=True,id=15ce325a-9c59-41ab-b96a-c1da8bd15896,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15ce325a-9c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=069fbd24-f210-49d4-bf0e-28df125ddd0c,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap069fbd24-f2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:9f:7e,bridge_name='br-int',has_traffic_filtering=True,id=ff9effc3-791c-4844-bfd7-3032135bb091,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9effc3-79') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00d838-5c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:40:cc,bridge_name='br-int',has_traffic_filtering=True,id=f446962d-48ce-4b5f-b105-d762c2338a0e,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446962d-48') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:be:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a858799-b2c0-421b-b998-8d229a9eb6d9,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a858799-b2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.objects.instance [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lazy-loading 'pci_devices' on Instance uuid 58fede94-cddc-4a5c-b223-e1894250147e {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:16:12 user nova-compute[74638]:   <uuid>58fede94-cddc-4a5c-b223-e1894250147e</uuid>
Nov 08 20:16:12 user nova-compute[74638]:   <name>instance-00000011</name>
Nov 08 20:16:12 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:16:12 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:16:12 user nova-compute[74638]:   <metadata>
Nov 08 20:16:12 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:16:12 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:16:12 user nova-compute[74638]:       <nova:name>tempest-device-tagging-server-1929721739</nova:name>
Nov 08 20:16:12 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:16:06</nova:creationTime>
Nov 08 20:16:12 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:16:12 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:16:12 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:16:12 user nova-compute[74638]:       <nova:owner>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:user uuid="44cdf63102fa4220946dc9b726622536">tempest-TaggedBootDevicesTest_v242-1950450066-project-member</nova:user>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:project uuid="77c8df0cff774621bc464646de80bbb7">tempest-TaggedBootDevicesTest_v242-1950450066</nova:project>
Nov 08 20:16:12 user nova-compute[74638]:       </nova:owner>
Nov 08 20:16:12 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:16:12 user nova-compute[74638]:       <nova:ports>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:port uuid="e2bfa746-5623-4be5-a820-87dcf5200be7">
Nov 08 20:16:12 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:16:12 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:port uuid="15ce325a-9c59-41ab-b96a-c1da8bd15896">
Nov 08 20:16:12 user nova-compute[74638]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
Nov 08 20:16:12 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:port uuid="069fbd24-f210-49d4-bf0e-28df125ddd0c">
Nov 08 20:16:12 user nova-compute[74638]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Nov 08 20:16:12 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:port uuid="ff9effc3-791c-4844-bfd7-3032135bb091">
Nov 08 20:16:12 user nova-compute[74638]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Nov 08 20:16:12 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:port uuid="3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f">
Nov 08 20:16:12 user nova-compute[74638]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Nov 08 20:16:12 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:port uuid="f446962d-48ce-4b5f-b105-d762c2338a0e">
Nov 08 20:16:12 user nova-compute[74638]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 20:16:12 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:12 user nova-compute[74638]:         <nova:port uuid="2a858799-b2c0-421b-b998-8d229a9eb6d9">
Nov 08 20:16:12 user nova-compute[74638]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 20:16:12 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:12 user nova-compute[74638]:       </nova:ports>
Nov 08 20:16:12 user nova-compute[74638]:     </nova:instance>
Nov 08 20:16:12 user nova-compute[74638]:   </metadata>
Nov 08 20:16:12 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:16:12 user nova-compute[74638]:     <system>
Nov 08 20:16:12 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:16:12 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:16:12 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:16:12 user nova-compute[74638]:       <entry name="serial">58fede94-cddc-4a5c-b223-e1894250147e</entry>
Nov 08 20:16:12 user nova-compute[74638]:       <entry name="uuid">58fede94-cddc-4a5c-b223-e1894250147e</entry>
Nov 08 20:16:12 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:16:12 user nova-compute[74638]:     </system>
Nov 08 20:16:12 user nova-compute[74638]:   </sysinfo>
Nov 08 20:16:12 user nova-compute[74638]:   <os>
Nov 08 20:16:12 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:16:12 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:16:12 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:16:12 user nova-compute[74638]:   </os>
Nov 08 20:16:12 user nova-compute[74638]:   <features>
Nov 08 20:16:12 user nova-compute[74638]:     <acpi/>
Nov 08 20:16:12 user nova-compute[74638]:     <apic/>
Nov 08 20:16:12 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:16:12 user nova-compute[74638]:   </features>
Nov 08 20:16:12 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:16:12 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:16:12 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:16:12 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:16:12 user nova-compute[74638]:   </clock>
Nov 08 20:16:12 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:16:12 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:16:12 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:16:12 user nova-compute[74638]:   </cpu>
Nov 08 20:16:12 user nova-compute[74638]:   <devices>
Nov 08 20:16:12 user nova-compute[74638]:     <disk type="file" device="cdrom">
Nov 08 20:16:12 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 20:16:12 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/58fede94-cddc-4a5c-b223-e1894250147e/disk.config"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="hda" bus="ide"/>
Nov 08 20:16:12 user nova-compute[74638]:     </disk>
Nov 08 20:16:12 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:16:12 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:16:12 user nova-compute[74638]:       <source dev="/dev/sdc"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <serial>809f9f7e-7770-419e-b371-d843ec0e2ccb</serial>
Nov 08 20:16:12 user nova-compute[74638]:     </disk>
Nov 08 20:16:12 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:16:12 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:16:12 user nova-compute[74638]:       <source dev="/dev/sdd"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <serial>bb61b6ca-5b3a-4a86-bd71-284a179ca687</serial>
Nov 08 20:16:12 user nova-compute[74638]:     </disk>
Nov 08 20:16:12 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:16:12 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:16:12 user nova-compute[74638]:       <source dev="/dev/sde"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="vdc" bus="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <serial>c53f8771-4bc3-48d9-b55d-e81c59676278</serial>
Nov 08 20:16:12 user nova-compute[74638]:     </disk>
Nov 08 20:16:12 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:12 user nova-compute[74638]:       <mac address="fa:16:3e:1b:ea:48"/>
Nov 08 20:16:12 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="tape2bfa746-56"/>
Nov 08 20:16:12 user nova-compute[74638]:     </interface>
Nov 08 20:16:12 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:12 user nova-compute[74638]:       <mac address="fa:16:3e:5a:6c:18"/>
Nov 08 20:16:12 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="tap15ce325a-9c"/>
Nov 08 20:16:12 user nova-compute[74638]:     </interface>
Nov 08 20:16:12 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:12 user nova-compute[74638]:       <mac address="fa:16:3e:4a:a1:4e"/>
Nov 08 20:16:12 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="tap069fbd24-f2"/>
Nov 08 20:16:12 user nova-compute[74638]:     </interface>
Nov 08 20:16:12 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:12 user nova-compute[74638]:       <mac address="fa:16:3e:65:9f:7e"/>
Nov 08 20:16:12 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="tapff9effc3-79"/>
Nov 08 20:16:12 user nova-compute[74638]:     </interface>
Nov 08 20:16:12 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:12 user nova-compute[74638]:       <mac address="fa:16:3e:72:a8:9f"/>
Nov 08 20:16:12 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="tap3d00d838-5c"/>
Nov 08 20:16:12 user nova-compute[74638]:     </interface>
Nov 08 20:16:12 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:12 user nova-compute[74638]:       <mac address="fa:16:3e:cc:40:cc"/>
Nov 08 20:16:12 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="tapf446962d-48"/>
Nov 08 20:16:12 user nova-compute[74638]:     </interface>
Nov 08 20:16:12 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:12 user nova-compute[74638]:       <mac address="fa:16:3e:41:be:cf"/>
Nov 08 20:16:12 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:12 user nova-compute[74638]:       <target dev="tap2a858799-b2"/>
Nov 08 20:16:12 user nova-compute[74638]:     </interface>
Nov 08 20:16:12 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:16:12 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/58fede94-cddc-4a5c-b223-e1894250147e/console.log" append="off"/>
Nov 08 20:16:12 user nova-compute[74638]:     </serial>
Nov 08 20:16:12 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:16:12 user nova-compute[74638]:     <video>
Nov 08 20:16:12 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:12 user nova-compute[74638]:     </video>
Nov 08 20:16:12 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:16:12 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:16:12 user nova-compute[74638]:     </rng>
Nov 08 20:16:12 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:16:12 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:16:12 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:16:12 user nova-compute[74638]:     </memballoon>
Nov 08 20:16:12 user nova-compute[74638]:   </devices>
Nov 08 20:16:12 user nova-compute[74638]: </domain>
Nov 08 20:16:12 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=e2bfa746-5623-4be5-a820-87dcf5200be7,network=Network(fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfa746-56') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=e2bfa746-5623-4be5-a820-87dcf5200be7,network=Network(fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfa746-56') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95afc9e1-1f1e-5af9-a1ed-96dd2f615f52', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2bfa746-56, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2bfa746-56, col_values=(('qos', UUID('7fadc5a1-90f5-4428-b3fc-f72d2a4b18db')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2bfa746-56, col_values=(('external_ids', {'iface-id': 'e2bfa746-5623-4be5-a820-87dcf5200be7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:ea:48', 'vm-uuid': '58fede94-cddc-4a5c-b223-e1894250147e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: INFO os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=e2bfa746-5623-4be5-a820-87dcf5200be7,network=Network(fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfa746-56')
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6c:18,bridge_name='br-int',has_traffic_filtering=True,id=15ce325a-9c59-41ab-b96a-c1da8bd15896,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15ce325a-9c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6c:18,bridge_name='br-int',has_traffic_filtering=True,id=15ce325a-9c59-41ab-b96a-c1da8bd15896,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15ce325a-9c') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88140ea5-6514-5b50-8252-0b163ad0a6f2', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15ce325a-9c, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15ce325a-9c, col_values=(('qos', UUID('5eff8368-bc67-43cb-9e6a-097d030587c2')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15ce325a-9c, col_values=(('external_ids', {'iface-id': '15ce325a-9c59-41ab-b96a-c1da8bd15896', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:6c:18', 'vm-uuid': '58fede94-cddc-4a5c-b223-e1894250147e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: INFO os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6c:18,bridge_name='br-int',has_traffic_filtering=True,id=15ce325a-9c59-41ab-b96a-c1da8bd15896,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15ce325a-9c')
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=069fbd24-f210-49d4-bf0e-28df125ddd0c,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap069fbd24-f2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=069fbd24-f210-49d4-bf0e-28df125ddd0c,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap069fbd24-f2') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be54ee7e-b282-5b96-b2af-c45681a74469', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap069fbd24-f2, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap069fbd24-f2, col_values=(('qos', UUID('fa04c2d6-6a0c-47a3-9d26-6f71de7a5c90')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap069fbd24-f2, col_values=(('external_ids', {'iface-id': '069fbd24-f210-49d4-bf0e-28df125ddd0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:a1:4e', 'vm-uuid': '58fede94-cddc-4a5c-b223-e1894250147e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: INFO os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=069fbd24-f210-49d4-bf0e-28df125ddd0c,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap069fbd24-f2')
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:9f:7e,bridge_name='br-int',has_traffic_filtering=True,id=ff9effc3-791c-4844-bfd7-3032135bb091,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9effc3-79') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:9f:7e,bridge_name='br-int',has_traffic_filtering=True,id=ff9effc3-791c-4844-bfd7-3032135bb091,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9effc3-79') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7982700b-2a2d-5778-a5a9-43e7838a5b2e', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff9effc3-79, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff9effc3-79, col_values=(('qos', UUID('f2b2c07e-19fc-45d2-a866-65cbbc6c7971')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff9effc3-79, col_values=(('external_ids', {'iface-id': 'ff9effc3-791c-4844-bfd7-3032135bb091', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:9f:7e', 'vm-uuid': '58fede94-cddc-4a5c-b223-e1894250147e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: INFO os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:9f:7e,bridge_name='br-int',has_traffic_filtering=True,id=ff9effc3-791c-4844-bfd7-3032135bb091,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9effc3-79')
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00d838-5c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00d838-5c') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06d55828-90a2-5b83-bdbd-0453568e742e', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d00d838-5c, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d00d838-5c, col_values=(('qos', UUID('79cf5a70-5dd4-4d08-92b8-ecfbde7f4193')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d00d838-5c, col_values=(('external_ids', {'iface-id': '3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:a8:9f', 'vm-uuid': '58fede94-cddc-4a5c-b223-e1894250147e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: INFO os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00d838-5c')
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:40:cc,bridge_name='br-int',has_traffic_filtering=True,id=f446962d-48ce-4b5f-b105-d762c2338a0e,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446962d-48') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:40:cc,bridge_name='br-int',has_traffic_filtering=True,id=f446962d-48ce-4b5f-b105-d762c2338a0e,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446962d-48') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62570a66-58ac-54d9-879e-9a3ae37ab412', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf446962d-48, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf446962d-48, col_values=(('qos', UUID('d0e312dd-da75-46de-a5a6-8c0bed323ede')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf446962d-48, col_values=(('external_ids', {'iface-id': 'f446962d-48ce-4b5f-b105-d762c2338a0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:40:cc', 'vm-uuid': '58fede94-cddc-4a5c-b223-e1894250147e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: INFO os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:40:cc,bridge_name='br-int',has_traffic_filtering=True,id=f446962d-48ce-4b5f-b105-d762c2338a0e,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446962d-48')
Nov 08 20:16:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:be:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a858799-b2c0-421b-b998-8d229a9eb6d9,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a858799-b2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:be:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a858799-b2c0-421b-b998-8d229a9eb6d9,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a858799-b2') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6ed3a71-400c-5c65-b04f-bd6660934b18', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a858799-b2, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a858799-b2, col_values=(('qos', UUID('6a0bf5a0-d87c-4eb9-a0b0-0463e2cf4de8')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a858799-b2, col_values=(('external_ids', {'iface-id': '2a858799-b2c0-421b-b998-8d229a9eb6d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:be:cf', 'vm-uuid': '58fede94-cddc-4a5c-b223-e1894250147e'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:13 user nova-compute[74638]: INFO os_vif [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:be:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a858799-b2c0-421b-b998-8d229a9eb6d9,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a858799-b2')
Nov 08 20:16:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] No BDM found with device name hda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] No VIF found with MAC fa:16:3e:1b:ea:48, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] No VIF found with MAC fa:16:3e:72:a8:9f, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:16:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Using config drive
Nov 08 20:16:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Creating config drive at /opt/stack/data/nova/instances/58fede94-cddc-4a5c-b223-e1894250147e/disk.config
Nov 08 20:16:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58fede94-cddc-4a5c-b223-e1894250147e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4gg9k2y0 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58fede94-cddc-4a5c-b223-e1894250147e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4gg9k2y0" returned: 0 in 0.075s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-94483e0e-66c4-4bb5-8aa3-1653e8f80dbf req-b7a47546-6368-40b0-8a5e-54a1fa5ec531 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94483e0e-66c4-4bb5-8aa3-1653e8f80dbf req-b7a47546-6368-40b0-8a5e-54a1fa5ec531 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94483e0e-66c4-4bb5-8aa3-1653e8f80dbf req-b7a47546-6368-40b0-8a5e-54a1fa5ec531 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94483e0e-66c4-4bb5-8aa3-1653e8f80dbf req-b7a47546-6368-40b0-8a5e-54a1fa5ec531 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-94483e0e-66c4-4bb5-8aa3-1653e8f80dbf req-b7a47546-6368-40b0-8a5e-54a1fa5ec531 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:15 user nova-compute[74638]: WARNING nova.compute.manager [req-94483e0e-66c4-4bb5-8aa3-1653e8f80dbf req-b7a47546-6368-40b0-8a5e-54a1fa5ec531 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 for instance with vm_state building and task_state spawning.
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-07d60314-0ad0-4d40-82a5-2050d5ffd708 req-1bd6213b-4b09-4d2d-a771-466c77a859de service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07d60314-0ad0-4d40-82a5-2050d5ffd708 req-1bd6213b-4b09-4d2d-a771-466c77a859de service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07d60314-0ad0-4d40-82a5-2050d5ffd708 req-1bd6213b-4b09-4d2d-a771-466c77a859de service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07d60314-0ad0-4d40-82a5-2050d5ffd708 req-1bd6213b-4b09-4d2d-a771-466c77a859de service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-07d60314-0ad0-4d40-82a5-2050d5ffd708 req-1bd6213b-4b09-4d2d-a771-466c77a859de service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:17 user nova-compute[74638]: WARNING nova.compute.manager [req-07d60314-0ad0-4d40-82a5-2050d5ffd708 req-1bd6213b-4b09-4d2d-a771-466c77a859de service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c for instance with vm_state building and task_state spawning.
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:18 user nova-compute[74638]: WARNING nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 for instance with vm_state building and task_state spawning.
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:18 user nova-compute[74638]: WARNING nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 for instance with vm_state building and task_state spawning.
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:18 user nova-compute[74638]: WARNING nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 for instance with vm_state building and task_state spawning.
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:18 user nova-compute[74638]: WARNING nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 for instance with vm_state building and task_state spawning.
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:18 user nova-compute[74638]: WARNING nova.compute.manager [req-b9876a7f-c132-4959-8628-7ce5adb15f0a req-b8fe5179-f142-4982-89bd-9403eadd9293 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 for instance with vm_state building and task_state spawning.
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-87962e31-7c71-4e32-91ec-a8d167a5028f req-b500706d-1f81-4121-b715-dd837dd7c80b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-87962e31-7c71-4e32-91ec-a8d167a5028f req-b500706d-1f81-4121-b715-dd837dd7c80b service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-87962e31-7c71-4e32-91ec-a8d167a5028f req-b500706d-1f81-4121-b715-dd837dd7c80b service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-87962e31-7c71-4e32-91ec-a8d167a5028f req-b500706d-1f81-4121-b715-dd837dd7c80b service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-87962e31-7c71-4e32-91ec-a8d167a5028f req-b500706d-1f81-4121-b715-dd837dd7c80b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:18 user nova-compute[74638]: WARNING nova.compute.manager [req-87962e31-7c71-4e32-91ec-a8d167a5028f req-b500706d-1f81-4121-b715-dd837dd7c80b service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 for instance with vm_state building and task_state spawning.
Nov 08 20:16:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:19 user nova-compute[74638]: WARNING nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c for instance with vm_state building and task_state spawning.
Nov 08 20:16:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:19 user nova-compute[74638]: WARNING nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f for instance with vm_state building and task_state spawning.
Nov 08 20:16:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:19 user nova-compute[74638]: WARNING nova.compute.manager [req-0e9c2039-06f5-4cd3-9a10-bd7ab1ebb9bd req-70a976c7-d1b8-49b1-a320-b3b2e942ee68 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f for instance with vm_state building and task_state spawning.
Nov 08 20:16:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:20 user nova-compute[74638]: WARNING nova.compute.manager [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e for instance with vm_state building and task_state spawning.
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:20 user nova-compute[74638]: WARNING nova.compute.manager [req-359bb9e7-96f1-4329-b704-aef129068766 req-d4f65d52-c656-4152-a73c-3655ed2e68ae service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e for instance with vm_state building and task_state spawning.
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-09663c6f-d540-4b84-b94d-b01beece1ed7 req-c296cd0a-85db-4adf-8828-5b5fab920f7d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-09663c6f-d540-4b84-b94d-b01beece1ed7 req-c296cd0a-85db-4adf-8828-5b5fab920f7d service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-09663c6f-d540-4b84-b94d-b01beece1ed7 req-c296cd0a-85db-4adf-8828-5b5fab920f7d service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-09663c6f-d540-4b84-b94d-b01beece1ed7 req-c296cd0a-85db-4adf-8828-5b5fab920f7d service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-09663c6f-d540-4b84-b94d-b01beece1ed7 req-c296cd0a-85db-4adf-8828-5b5fab920f7d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:20 user nova-compute[74638]: WARNING nova.compute.manager [req-09663c6f-d540-4b84-b94d-b01beece1ed7 req-c296cd0a-85db-4adf-8828-5b5fab920f7d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 for instance with vm_state building and task_state spawning.
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:16:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance spawned successfully.
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:16:20 user nova-compute[74638]: INFO nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Took 14.81 seconds to spawn the instance on the hypervisor.
Nov 08 20:16:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:16:21 user nova-compute[74638]: INFO nova.compute.manager [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Took 179.70 seconds to build instance.
Nov 08 20:16:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-605a5ece-6bda-4d15-8c70-bc8c7327fdc7 tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "58fede94-cddc-4a5c-b223-e1894250147e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 179.817s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "07aab635-2120-4d29-8e6b-40a725ed8f37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:26 user nova-compute[74638]: INFO nova.compute.manager [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Terminating instance
Nov 08 20:16:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-1242e237-13d6-4667-a9ac-8c5b8b6ba8b1 req-8c4e144a-f345-446f-bc39-b7c0a58edb9f service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received event network-vif-unplugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1242e237-13d6-4667-a9ac-8c5b8b6ba8b1 req-8c4e144a-f345-446f-bc39-b7c0a58edb9f service nova] Acquiring lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1242e237-13d6-4667-a9ac-8c5b8b6ba8b1 req-8c4e144a-f345-446f-bc39-b7c0a58edb9f service nova] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1242e237-13d6-4667-a9ac-8c5b8b6ba8b1 req-8c4e144a-f345-446f-bc39-b7c0a58edb9f service nova] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-1242e237-13d6-4667-a9ac-8c5b8b6ba8b1 req-8c4e144a-f345-446f-bc39-b7c0a58edb9f service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] No waiting events found dispatching network-vif-unplugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-1242e237-13d6-4667-a9ac-8c5b8b6ba8b1 req-8c4e144a-f345-446f-bc39-b7c0a58edb9f service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received event network-vif-unplugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:16:27 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Instance destroyed successfully.
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lazy-loading 'resources' on Instance uuid 07aab635-2120-4d29-8e6b-40a725ed8f37 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1626769250',display_name='tempest-ServersNegativeTestJSON-server-1626769250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1626769250',id=2,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcc60419b64f4d509a058b6ad7c756f6',ramdisk_id='',reservation_id='r-cgfr4bj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-300367152',owner_user_name='tempest-ServersNegativeTestJSON-300367152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:11Z,user_data=None,user_id='4d337a855b2f47849995109533421233',uuid=07aab635-2120-4d29-8e6b-40a725ed8f37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converting VIF {"id": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "address": "fa:16:3e:24:72:93", "network": {"id": "7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1218882864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc60419b64f4d509a058b6ad7c756f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5a8d2b1-ad", "ovs_interfaceid": "d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:72:93,bridge_name='br-int',has_traffic_filtering=True,id=d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a8d2b1-ad') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG os_vif [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:72:93,bridge_name='br-int',has_traffic_filtering=True,id=d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a8d2b1-ad') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5a8d2b1-ad, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4569030-bc38-4596-858b-880002bc7f47) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:16:27 user nova-compute[74638]: INFO os_vif [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:72:93,bridge_name='br-int',has_traffic_filtering=True,id=d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b,network=Network(7f4bd5f6-6dea-4d87-b50e-c42e163f7a0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5a8d2b1-ad')
Nov 08 20:16:27 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Deleting instance files /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37_del
Nov 08 20:16:27 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Deletion of /opt/stack/data/nova/instances/07aab635-2120-4d29-8e6b-40a725ed8f37_del complete
Nov 08 20:16:27 user nova-compute[74638]: INFO nova.compute.manager [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 08 20:16:27 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:16:27 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:16:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:28 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:16:28 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Took 1.01 seconds to deallocate network for instance.
Nov 08 20:16:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-f1e17d0a-03c6-43b2-afea-585edf660fa0 req-b43cc359-a934-4d82-9882-18f658ce2bd6 service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received event network-vif-deleted-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:29 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:16:29 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:16:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:29 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Deleted allocations for instance 07aab635-2120-4d29-8e6b-40a725ed8f37
Nov 08 20:16:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-d7dad658-e965-4615-8381-a0ced4a9adc3 req-2bbebfbe-2673-41ed-a382-46eb5c10ff5d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received event network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7dad658-e965-4615-8381-a0ced4a9adc3 req-2bbebfbe-2673-41ed-a382-46eb5c10ff5d service nova] Acquiring lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7dad658-e965-4615-8381-a0ced4a9adc3 req-2bbebfbe-2673-41ed-a382-46eb5c10ff5d service nova] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7dad658-e965-4615-8381-a0ced4a9adc3 req-2bbebfbe-2673-41ed-a382-46eb5c10ff5d service nova] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-d7dad658-e965-4615-8381-a0ced4a9adc3 req-2bbebfbe-2673-41ed-a382-46eb5c10ff5d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] No waiting events found dispatching network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:29 user nova-compute[74638]: WARNING nova.compute.manager [req-d7dad658-e965-4615-8381-a0ced4a9adc3 req-2bbebfbe-2673-41ed-a382-46eb5c10ff5d service nova] [instance: 07aab635-2120-4d29-8e6b-40a725ed8f37] Received unexpected event network-vif-plugged-d5a8d2b1-adb2-48c9-b4a1-b7a3f6e8646b for instance with vm_state deleted and task_state None.
Nov 08 20:16:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a71ea8fc-016a-480b-a4de-5c5662c284bc tempest-ServersNegativeTestJSON-300367152 tempest-ServersNegativeTestJSON-300367152-project-member] Lock "07aab635-2120-4d29-8e6b-40a725ed8f37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.585s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:31 user nova-compute[74638]: INFO nova.compute.manager [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Rescuing
Nov 08 20:16:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:16:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquired lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:16:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:16:32 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updating instance_info_cache with network_info: [{"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:16:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Releasing lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:16:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Instance destroyed successfully.
Nov 08 20:16:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Attempting rescue
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74638) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Instance directory exists: not creating {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 20:16:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Creating image(s)
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-97a457d3-1c9c-4145-b100-4b877c5d8278 req-77169138-ccb3-47ba-a22d-2530e9b13172 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-unplugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97a457d3-1c9c-4145-b100-4b877c5d8278 req-77169138-ccb3-47ba-a22d-2530e9b13172 service nova] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97a457d3-1c9c-4145-b100-4b877c5d8278 req-77169138-ccb3-47ba-a22d-2530e9b13172 service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97a457d3-1c9c-4145-b100-4b877c5d8278 req-77169138-ccb3-47ba-a22d-2530e9b13172 service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-97a457d3-1c9c-4145-b100-4b877c5d8278 req-77169138-ccb3-47ba-a22d-2530e9b13172 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] No waiting events found dispatching network-vif-unplugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:33 user nova-compute[74638]: WARNING nova.compute.manager [req-97a457d3-1c9c-4145-b100-4b877c5d8278 req-77169138-ccb3-47ba-a22d-2530e9b13172 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received unexpected event network-vif-unplugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 for instance with vm_state active and task_state rescuing.
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.266s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue" returned: 0 in 0.066s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'migration_context' on Instance uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<9f955212-6cf6-4f51-944a-5a3482082fda> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Start _get_guest_xml network_info=[{"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:c4:59:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'resources' on Instance uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<9f955212-6cf6-4f51-944a-5a3482082fda> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<9f955212-6cf6-4f51-944a-5a3482082fda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:16:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<9f955212-6cf6-4f51-944a-5a3482082fda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-84924301',display_name='tempest-ServerRescueNegativeTestJSON-server-84924301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-84924301',id=19,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:14:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-kgkrpcj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:14:50Z,user_data=None,user_id='444c578cebff4167825165a737b5bb85',uuid=9f955212-6cf6-4f51-944a-5a3482082fda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:c4:59:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:c4:59:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=d23059b2-a4de-4b0f-8434-f4ff2e88f927,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23059b2-a4') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<9f955212-6cf6-4f51-944a-5a3482082fda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:16:33 user nova-compute[74638]:   <uuid>9f955212-6cf6-4f51-944a-5a3482082fda</uuid>
Nov 08 20:16:33 user nova-compute[74638]:   <name>instance-00000013</name>
Nov 08 20:16:33 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:16:33 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:16:33 user nova-compute[74638]:   <metadata>
Nov 08 20:16:33 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:16:33 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:16:33 user nova-compute[74638]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-84924301</nova:name>
Nov 08 20:16:33 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:16:33</nova:creationTime>
Nov 08 20:16:33 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:16:33 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:16:33 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:16:33 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:16:33 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:16:33 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:16:33 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:16:33 user nova-compute[74638]:       <nova:owner>
Nov 08 20:16:33 user nova-compute[74638]:         <nova:user uuid="444c578cebff4167825165a737b5bb85">tempest-ServerRescueNegativeTestJSON-1603324862-project-member</nova:user>
Nov 08 20:16:33 user nova-compute[74638]:         <nova:project uuid="e5f133d71d494371b87181e746074d70">tempest-ServerRescueNegativeTestJSON-1603324862</nova:project>
Nov 08 20:16:33 user nova-compute[74638]:       </nova:owner>
Nov 08 20:16:33 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:16:33 user nova-compute[74638]:       <nova:ports>
Nov 08 20:16:33 user nova-compute[74638]:         <nova:port uuid="d23059b2-a4de-4b0f-8434-f4ff2e88f927">
Nov 08 20:16:33 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 20:16:33 user nova-compute[74638]:         </nova:port>
Nov 08 20:16:33 user nova-compute[74638]:       </nova:ports>
Nov 08 20:16:33 user nova-compute[74638]:     </nova:instance>
Nov 08 20:16:33 user nova-compute[74638]:   </metadata>
Nov 08 20:16:33 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:16:33 user nova-compute[74638]:     <system>
Nov 08 20:16:33 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:16:33 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:16:33 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:16:33 user nova-compute[74638]:       <entry name="serial">9f955212-6cf6-4f51-944a-5a3482082fda</entry>
Nov 08 20:16:33 user nova-compute[74638]:       <entry name="uuid">9f955212-6cf6-4f51-944a-5a3482082fda</entry>
Nov 08 20:16:33 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:16:33 user nova-compute[74638]:     </system>
Nov 08 20:16:33 user nova-compute[74638]:   </sysinfo>
Nov 08 20:16:33 user nova-compute[74638]:   <os>
Nov 08 20:16:33 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:16:33 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:16:33 user nova-compute[74638]:   </os>
Nov 08 20:16:33 user nova-compute[74638]:   <features>
Nov 08 20:16:33 user nova-compute[74638]:     <acpi/>
Nov 08 20:16:33 user nova-compute[74638]:     <apic/>
Nov 08 20:16:33 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:16:33 user nova-compute[74638]:   </features>
Nov 08 20:16:33 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:16:33 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:16:33 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:16:33 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:16:33 user nova-compute[74638]:   </clock>
Nov 08 20:16:33 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:16:33 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:16:33 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:16:33 user nova-compute[74638]:   </cpu>
Nov 08 20:16:33 user nova-compute[74638]:   <devices>
Nov 08 20:16:33 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:16:33 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:16:33 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue"/>
Nov 08 20:16:33 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:16:33 user nova-compute[74638]:     </disk>
Nov 08 20:16:33 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:16:33 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:16:33 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk"/>
Nov 08 20:16:33 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:16:33 user nova-compute[74638]:     </disk>
Nov 08 20:16:33 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:16:33 user nova-compute[74638]:       <mac address="fa:16:3e:c4:59:0a"/>
Nov 08 20:16:33 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:33 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:16:33 user nova-compute[74638]:       <target dev="tapd23059b2-a4"/>
Nov 08 20:16:33 user nova-compute[74638]:     </interface>
Nov 08 20:16:33 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:16:33 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/console.log" append="off"/>
Nov 08 20:16:33 user nova-compute[74638]:     </serial>
Nov 08 20:16:33 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:16:33 user nova-compute[74638]:     <video>
Nov 08 20:16:33 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:16:33 user nova-compute[74638]:     </video>
Nov 08 20:16:33 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:16:33 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:16:33 user nova-compute[74638]:     </rng>
Nov 08 20:16:33 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:16:33 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:16:33 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:16:33 user nova-compute[74638]:     </memballoon>
Nov 08 20:16:33 user nova-compute[74638]:   </devices>
Nov 08 20:16:33 user nova-compute[74638]: </domain>
Nov 08 20:16:33 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:16:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Instance destroyed successfully.
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:16:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No VIF found with MAC fa:16:3e:c4:59:0a, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] No waiting events found dispatching network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:35 user nova-compute[74638]: WARNING nova.compute.manager [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received unexpected event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 for instance with vm_state active and task_state rescuing.
Nov 08 20:16:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] No waiting events found dispatching network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:35 user nova-compute[74638]: WARNING nova.compute.manager [req-cd95cc13-3563-4d60-84a4-6f959def1e1c req-92b9b40b-3e23-4066-bb89-765dd9b167fd service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received unexpected event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 for instance with vm_state active and task_state rescuing.
Nov 08 20:16:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:37 user nova-compute[74638]: DEBUG nova.compute.manager [req-30ee2cf2-0361-4eee-83a6-c2d788be2bd5 req-5e336438-5716-4b8f-8271-5117e5b25d2e service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:16:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-30ee2cf2-0361-4eee-83a6-c2d788be2bd5 req-5e336438-5716-4b8f-8271-5117e5b25d2e service nova] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:16:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-30ee2cf2-0361-4eee-83a6-c2d788be2bd5 req-5e336438-5716-4b8f-8271-5117e5b25d2e service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:16:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-30ee2cf2-0361-4eee-83a6-c2d788be2bd5 req-5e336438-5716-4b8f-8271-5117e5b25d2e service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:16:37 user nova-compute[74638]: DEBUG nova.compute.manager [req-30ee2cf2-0361-4eee-83a6-c2d788be2bd5 req-5e336438-5716-4b8f-8271-5117e5b25d2e service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] No waiting events found dispatching network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:16:37 user nova-compute[74638]: WARNING nova.compute.manager [req-30ee2cf2-0361-4eee-83a6-c2d788be2bd5 req-5e336438-5716-4b8f-8271-5117e5b25d2e service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received unexpected event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 for instance with vm_state active and task_state rescuing.
Nov 08 20:16:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a976c6d1-1d81-4a66-97e3-191aab8ec038 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:16:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:50 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:16:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:16:51 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:52 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:16:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:58 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:16:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:16:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:16:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:16:59 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:16:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:16:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:16:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:16:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:17:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:03 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:17:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:07 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:17:07 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7486MB free_disk=25.419151306152344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f91c46b4-8ab6-4480-80e0-5e6df682e609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 1953f44c-b839-4515-a0b4-1212bfa93092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 105b86cf-4f0f-4003-8407-42b945553b18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 58fede94-cddc-4a5c-b223-e1894250147e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 61243e09-42f2-4c57-8426-5aa54e0ad99a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:17:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:08 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:17:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:25 user nova-compute[74638]: INFO nova.compute.manager [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Terminating instance
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Instance destroyed successfully.
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'resources' on Instance uuid f91c46b4-8ab6-4480-80e0-5e6df682e609 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261014533',display_name='tempest-AttachVolumeTestJSON-server-1261014533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261014533',id=4,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN29pRM5owAzMe+2LdZrStBq5j13Dm9NPub21BUQ0RTSxYF5Dau7knkwsFocanhODD2+4hNevWzpP9wOei0tTgPpni20893gsXifyCsAoa9Vv1RQb6N0DY/VnRkLog4p6A==',key_name='tempest-keypair-1023148006',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-u7uq28nv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:15:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=f91c46b4-8ab6-4480-80e0-5e6df682e609,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "2dae479f-02ee-40bc-8a5d-436e3931e032", "address": "fa:16:3e:32:99:5e", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dae479f-02", "ovs_interfaceid": "2dae479f-02ee-40bc-8a5d-436e3931e032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG os_vif [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dae479f-02, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54c22424-d4a3-4070-8538-4f4b50c82644) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:25 user nova-compute[74638]: INFO os_vif [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:99:5e,bridge_name='br-int',has_traffic_filtering=True,id=2dae479f-02ee-40bc-8a5d-436e3931e032,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dae479f-02')
Nov 08 20:17:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Deleting instance files /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609_del
Nov 08 20:17:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Deletion of /opt/stack/data/nova/instances/f91c46b4-8ab6-4480-80e0-5e6df682e609_del complete
Nov 08 20:17:25 user nova-compute[74638]: INFO nova.compute.manager [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-717b6fca-ff62-4326-90fd-53a9d1eeb651 req-eb770e4f-315c-4eb6-91f6-1e4ae3cdd904 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-717b6fca-ff62-4326-90fd-53a9d1eeb651 req-eb770e4f-315c-4eb6-91f6-1e4ae3cdd904 service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-717b6fca-ff62-4326-90fd-53a9d1eeb651 req-eb770e4f-315c-4eb6-91f6-1e4ae3cdd904 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-717b6fca-ff62-4326-90fd-53a9d1eeb651 req-eb770e4f-315c-4eb6-91f6-1e4ae3cdd904 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-717b6fca-ff62-4326-90fd-53a9d1eeb651 req-eb770e4f-315c-4eb6-91f6-1e4ae3cdd904 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-717b6fca-ff62-4326-90fd-53a9d1eeb651 req-eb770e4f-315c-4eb6-91f6-1e4ae3cdd904 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-unplugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:17:27 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:27 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Took 1.24 seconds to deallocate network for instance.
Nov 08 20:17:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-abc8cd8d-01f9-407a-99da-d44afaf72321 req-8016f139-0102-4fb0-9841-c00e4b573c45 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-deleted-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:27 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:17:27 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:17:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:27 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Deleted allocations for instance f91c46b4-8ab6-4480-80e0-5e6df682e609
Nov 08 20:17:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c7b7540-d66d-45d7-a439-913d786d54e1 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.543s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-94e01524-9c4f-4881-9555-ea640d342872 req-498339db-ee72-4e94-ab59-7d59e5abef07 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94e01524-9c4f-4881-9555-ea640d342872 req-498339db-ee72-4e94-ab59-7d59e5abef07 service nova] Acquiring lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94e01524-9c4f-4881-9555-ea640d342872 req-498339db-ee72-4e94-ab59-7d59e5abef07 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94e01524-9c4f-4881-9555-ea640d342872 req-498339db-ee72-4e94-ab59-7d59e5abef07 service nova] Lock "f91c46b4-8ab6-4480-80e0-5e6df682e609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-94e01524-9c4f-4881-9555-ea640d342872 req-498339db-ee72-4e94-ab59-7d59e5abef07 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] No waiting events found dispatching network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:28 user nova-compute[74638]: WARNING nova.compute.manager [req-94e01524-9c4f-4881-9555-ea640d342872 req-498339db-ee72-4e94-ab59-7d59e5abef07 service nova] [instance: f91c46b4-8ab6-4480-80e0-5e6df682e609] Received unexpected event network-vif-plugged-2dae479f-02ee-40bc-8a5d-436e3931e032 for instance with vm_state deleted and task_state None.
Nov 08 20:17:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-65d50777-43d7-41c5-837b-d5ad2a206350 req-5624d692-bb6a-4eea-bd00-13642ca220a7 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-changed-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-65d50777-43d7-41c5-837b-d5ad2a206350 req-5624d692-bb6a-4eea-bd00-13642ca220a7 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing instance network info cache due to event network-changed-e2bfa746-5623-4be5-a820-87dcf5200be7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:17:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65d50777-43d7-41c5-837b-d5ad2a206350 req-5624d692-bb6a-4eea-bd00-13642ca220a7 service nova] Acquiring lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:17:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65d50777-43d7-41c5-837b-d5ad2a206350 req-5624d692-bb6a-4eea-bd00-13642ca220a7 service nova] Acquired lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:17:44 user nova-compute[74638]: DEBUG nova.network.neutron [req-65d50777-43d7-41c5-837b-d5ad2a206350 req-5624d692-bb6a-4eea-bd00-13642ca220a7 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Refreshing network info cache for port e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:17:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-65d50777-43d7-41c5-837b-d5ad2a206350 req-5624d692-bb6a-4eea-bd00-13642ca220a7 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updated VIF entry in instance network info cache for port e2bfa746-5623-4be5-a820-87dcf5200be7. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:17:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-65d50777-43d7-41c5-837b-d5ad2a206350 req-5624d692-bb6a-4eea-bd00-13642ca220a7 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [{"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65d50777-43d7-41c5-837b-d5ad2a206350 req-5624d692-bb6a-4eea-bd00-13642ca220a7 service nova] Releasing lock "refresh_cache-58fede94-cddc-4a5c-b223-e1894250147e" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:17:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "58fede94-cddc-4a5c-b223-e1894250147e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:47 user nova-compute[74638]: INFO nova.compute.manager [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Terminating instance
Nov 08 20:17:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-8a28a33e-f5ff-4477-80cd-cc53d4afc122 req-22f3fcdb-cd73-433e-a883-fdb78dae897c service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8a28a33e-f5ff-4477-80cd-cc53d4afc122 req-22f3fcdb-cd73-433e-a883-fdb78dae897c service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8a28a33e-f5ff-4477-80cd-cc53d4afc122 req-22f3fcdb-cd73-433e-a883-fdb78dae897c service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8a28a33e-f5ff-4477-80cd-cc53d4afc122 req-22f3fcdb-cd73-433e-a883-fdb78dae897c service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-8a28a33e-f5ff-4477-80cd-cc53d4afc122 req-22f3fcdb-cd73-433e-a883-fdb78dae897c service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-unplugged-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-8a28a33e-f5ff-4477-80cd-cc53d4afc122 req-22f3fcdb-cd73-433e-a883-fdb78dae897c service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-e2bfa746-5623-4be5-a820-87dcf5200be7 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-8e87044a-9b6a-474b-9c62-f3fc6d4b5c49 req-72b587cd-e14a-4cf2-b6ad-029447872b71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8e87044a-9b6a-474b-9c62-f3fc6d4b5c49 req-72b587cd-e14a-4cf2-b6ad-029447872b71 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8e87044a-9b6a-474b-9c62-f3fc6d4b5c49 req-72b587cd-e14a-4cf2-b6ad-029447872b71 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8e87044a-9b6a-474b-9c62-f3fc6d4b5c49 req-72b587cd-e14a-4cf2-b6ad-029447872b71 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-8e87044a-9b6a-474b-9c62-f3fc6d4b5c49 req-72b587cd-e14a-4cf2-b6ad-029447872b71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-unplugged-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-8e87044a-9b6a-474b-9c62-f3fc6d4b5c49 req-72b587cd-e14a-4cf2-b6ad-029447872b71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-069fbd24-f210-49d4-bf0e-28df125ddd0c for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-813430aa-61ba-40f0-9119-79d261302c3f req-8cfbdd5b-d6c8-4323-bf1d-1c45a99fd917 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-813430aa-61ba-40f0-9119-79d261302c3f req-8cfbdd5b-d6c8-4323-bf1d-1c45a99fd917 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-813430aa-61ba-40f0-9119-79d261302c3f req-8cfbdd5b-d6c8-4323-bf1d-1c45a99fd917 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-813430aa-61ba-40f0-9119-79d261302c3f req-8cfbdd5b-d6c8-4323-bf1d-1c45a99fd917 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-813430aa-61ba-40f0-9119-79d261302c3f req-8cfbdd5b-d6c8-4323-bf1d-1c45a99fd917 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-unplugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-813430aa-61ba-40f0-9119-79d261302c3f req-8cfbdd5b-d6c8-4323-bf1d-1c45a99fd917 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:17:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Instance destroyed successfully.
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lazy-loading 'resources' on Instance uuid 58fede94-cddc-4a5c-b223-e1894250147e {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=e2bfa746-5623-4be5-a820-87dcf5200be7,network=Network(fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfa746-56') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=e2bfa746-5623-4be5-a820-87dcf5200be7,network=Network(fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfa746-56') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2bfa746-56, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fadc5a1-90f5-4428-b3fc-f72d2a4b18db) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: INFO os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=e2bfa746-5623-4be5-a820-87dcf5200be7,network=Network(fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bfa746-56')
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6c:18,bridge_name='br-int',has_traffic_filtering=True,id=15ce325a-9c59-41ab-b96a-c1da8bd15896,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15ce325a-9c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6c:18,bridge_name='br-int',has_traffic_filtering=True,id=15ce325a-9c59-41ab-b96a-c1da8bd15896,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15ce325a-9c') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15ce325a-9c, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5eff8368-bc67-43cb-9e6a-097d030587c2) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: INFO os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6c:18,bridge_name='br-int',has_traffic_filtering=True,id=15ce325a-9c59-41ab-b96a-c1da8bd15896,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15ce325a-9c')
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=069fbd24-f210-49d4-bf0e-28df125ddd0c,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap069fbd24-f2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=069fbd24-f210-49d4-bf0e-28df125ddd0c,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap069fbd24-f2') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap069fbd24-f2, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa04c2d6-6a0c-47a3-9d26-6f71de7a5c90) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:49 user nova-compute[74638]: WARNING nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-e2bfa746-5623-4be5-a820-87dcf5200be7 for instance with vm_state active and task_state deleting.
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-unplugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:49 user nova-compute[74638]: WARNING nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-15ce325a-9c59-41ab-b96a-c1da8bd15896 for instance with vm_state active and task_state deleting.
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-unplugged-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-ff9effc3-791c-4844-bfd7-3032135bb091 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:49 user nova-compute[74638]: WARNING nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-ff9effc3-791c-4844-bfd7-3032135bb091 for instance with vm_state active and task_state deleting.
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-unplugged-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-f446962d-48ce-4b5f-b105-d762c2338a0e for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:49 user nova-compute[74638]: WARNING nova.compute.manager [req-2b0eabd7-810c-4782-9ac3-5d3f0565f7c7 req-28b05f2e-33fc-42fe-8006-e8568842ddcd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-f446962d-48ce-4b5f-b105-d762c2338a0e for instance with vm_state active and task_state deleting.
Nov 08 20:17:49 user nova-compute[74638]: INFO os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=069fbd24-f210-49d4-bf0e-28df125ddd0c,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap069fbd24-f2')
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "ff9effc3-791c-4844-bfd7-3032135bb091", "address": "fa:16:3e:65:9f:7e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9effc3-79", "ovs_interfaceid": "ff9effc3-791c-4844-bfd7-3032135bb091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:9f:7e,bridge_name='br-int',has_traffic_filtering=True,id=ff9effc3-791c-4844-bfd7-3032135bb091,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9effc3-79') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:9f:7e,bridge_name='br-int',has_traffic_filtering=True,id=ff9effc3-791c-4844-bfd7-3032135bb091,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9effc3-79') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff9effc3-79, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2b2c07e-19fc-45d2-a866-65cbbc6c7971) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: INFO os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:9f:7e,bridge_name='br-int',has_traffic_filtering=True,id=ff9effc3-791c-4844-bfd7-3032135bb091,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9effc3-79')
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00d838-5c') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00d838-5c') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d00d838-5c, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79cf5a70-5dd4-4d08-92b8-ecfbde7f4193) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: INFO os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:a8:9f,bridge_name='br-int',has_traffic_filtering=True,id=3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f,network=Network(ed1b29a9-70f6-4584-ac44-dd9db5f680bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d00d838-5c')
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:40:cc,bridge_name='br-int',has_traffic_filtering=True,id=f446962d-48ce-4b5f-b105-d762c2338a0e,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446962d-48') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:40:cc,bridge_name='br-int',has_traffic_filtering=True,id=f446962d-48ce-4b5f-b105-d762c2338a0e,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446962d-48') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf446962d-48, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0e312dd-da75-46de-a5a6-8c0bed323ede) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: INFO os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:40:cc,bridge_name='br-int',has_traffic_filtering=True,id=f446962d-48ce-4b5f-b105-d762c2338a0e,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf446962d-48')
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T20:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1929721739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1929721739',id=17,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgflnYy/5OQHf5I2Fv7dv712QD8TOedx1y649R/pJGFEeEOF78/sCJR7GD+KYz4Gn7e87KRrtK0A7tf3dz3EpNF+NgE2WfF9kLV9GSAQLEblTlzerSzVtP2VeNQ7bTL9g==',key_name='tempest-keypair-204204346',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c8df0cff774621bc464646de80bbb7',ramdisk_id='',reservation_id='r-27759yg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1950450066',owner_user_name='tempest-TaggedBootDevicesTest_v242-1950450066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44cdf63102fa4220946dc9b726622536',uuid=58fede94-cddc-4a5c-b223-e1894250147e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converting VIF {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:be:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a858799-b2c0-421b-b998-8d229a9eb6d9,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a858799-b2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:be:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a858799-b2c0-421b-b998-8d229a9eb6d9,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a858799-b2') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a858799-b2, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a0bf5a0-d87c-4eb9-a0b0-0463e2cf4de8) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:50 user nova-compute[74638]: INFO os_vif [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:be:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a858799-b2c0-421b-b998-8d229a9eb6d9,network=Network(c6a96616-0d8b-463e-9a73-57d925a5189b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a858799-b2')
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AIZGVHRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:17:50 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cecdf8-76f2-4fe1-bfe0-e1bf617663ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]: iSNS:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]: STATIC:
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: FIRMWARE:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:17:50 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:17:50 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:50 user nova-compute[74638]: WARNING nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-069fbd24-f210-49d4-bf0e-28df125ddd0c for instance with vm_state active and task_state deleting.
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-unplugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-unplugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:50 user nova-compute[74638]: WARNING nova.compute.manager [req-b557b946-ea5e-483e-bd2e-6e3a6655fd8f req-5d793f31-8674-440c-b39a-9483a09f199d service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f for instance with vm_state active and task_state deleting.
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d2deac-ef56-4bf1-a61a-37e70cd8328c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3f031f-02da-453d-b550-2bc01de7f3cf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3ef9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c75af-7802-45bc-8201-f707bc63d009]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a357ea0-8df4-43fb-82a2-e3c31c56781f]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8e8228-a232-4522-b5f2-0bc4b4dd8887]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c05468b-0483-448f-ac2d-14292638b592]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[de062421-6ecf-4319-bf2a-678fbdf1e593]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: INFO nova.compute.manager [None req-63f35594-a482-4cb8-8bed-96c5631b1e03 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Unrescuing
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-63f35594-a482-4cb8-8bed-96c5631b1e03 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-63f35594-a482-4cb8-8bed-96c5631b1e03 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquired lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-63f35594-a482-4cb8-8bed-96c5631b1e03 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ea38d0-9574-4117-849a-4adf07928304]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb, portal: 172.16.0.220,3260]
Nov 08 20:17:50 user nova-compute[74638]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb, portal: 172.16.0.220,3260] successful.
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809f9f7e-7770-419e-b371-d843ec0e2ccb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c9cde6-e203-4b29-ae94-d245f63cb6f3]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== disconnect_volume: return (392ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpICbLRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:17:50 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315c4df-67db-4d0e-94f4-f38b8c63fd00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]: iSNS:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]: STATIC:
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: FIRMWARE:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:17:50 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:17:50 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[54396ea7-f397-4d5b-815e-8966f623045f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13bd4f8-b1d8-4db7-8e56-00c99e29fd08]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c5c9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb742d7e-dbd3-44f6-9a9f-8fe611077204]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fabe007-d4c0-47d6-8ee2-c383bcef16a5]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[79738974-0e42-473f-a6cd-12aa513b6127]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb0264-0447-4b1c-b974-94b0e4d5a036]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbd65c2-0c98-4450-b534-e9ed8c469b56]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9ccd7e-4116-4284-ac6e-368e5adf491d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687, portal: 172.16.0.220,3260]
Nov 08 20:17:50 user nova-compute[74638]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687, portal: 172.16.0.220,3260] successful.
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb61b6ca-5b3a-4a86-bd71-284a179ca687 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3dec3d-e5ba-44a7-8e54-1dacf601202d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== disconnect_volume: return (374ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JbsxQmKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:17:50 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d1e76b-d544-45d4-b425-bb27dac7ab01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]: iSNS:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]: STATIC:
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066
Nov 08 20:17:50 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:17:50 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:17:50 user nova-compute[74638]: FIRMWARE:
Nov 08 20:17:50 user nova-compute[74638]: No targets found.
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:17:50 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:17:50 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fcd5e3-0187-49eb-97eb-4634fb1409db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-091dced7-8529-4796-8232-e3e8d5fcdfeb req-a7935baf-069c-4ac2-8766-50c2325771c5 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-091dced7-8529-4796-8232-e3e8d5fcdfeb req-a7935baf-069c-4ac2-8766-50c2325771c5 service nova] Acquiring lock "58fede94-cddc-4a5c-b223-e1894250147e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-091dced7-8529-4796-8232-e3e8d5fcdfeb req-a7935baf-069c-4ac2-8766-50c2325771c5 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-091dced7-8529-4796-8232-e3e8d5fcdfeb req-a7935baf-069c-4ac2-8766-50c2325771c5 service nova] Lock "58fede94-cddc-4a5c-b223-e1894250147e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-091dced7-8529-4796-8232-e3e8d5fcdfeb req-a7935baf-069c-4ac2-8766-50c2325771c5 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] No waiting events found dispatching network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:50 user nova-compute[74638]: WARNING nova.compute.manager [req-091dced7-8529-4796-8232-e3e8d5fcdfeb req-a7935baf-069c-4ac2-8766-50c2325771c5 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received unexpected event network-vif-plugged-2a858799-b2c0-421b-b998-8d229a9eb6d9 for instance with vm_state active and task_state deleting.
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c793cd-40a1-4383-927c-b3fdb047f6cf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 (non-flash)
Nov 08 20:17:50 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c3f3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-63f35594-a482-4cb8-8bed-96c5631b1e03 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5733f9-f3f6-463c-a0c4-d215c5fa9747]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-63f35594-a482-4cb8-8bed-96c5631b1e03 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Releasing lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG nova.objects.instance [None req-63f35594-a482-4cb8-8bed-96c5631b1e03 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'flavor' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ff1eba-6be0-4a4f-973d-4720fae86218]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f204da-ab1d-4008-93dc-22b503233be6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d10daf4-38df-4d24-8e2b-8e647cd9e091]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b77208-813b-4068-8760-ad0366134811]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b28393a-acfb-4509-a079-0304c60102a8]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278, portal: 172.16.0.220,3260]
Nov 08 20:17:51 user nova-compute[74638]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278, portal: 172.16.0.220,3260] successful.
Nov 08 20:17:51 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c53f8771-4bc3-48d9-b55d-e81c59676278 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[80965701-4171-408c-acd5-2ea81a21cc4b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] <== disconnect_volume: return (391ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:17:51 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Deleting instance files /opt/stack/data/nova/instances/58fede94-cddc-4a5c-b223-e1894250147e_del
Nov 08 20:17:51 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Deletion of /opt/stack/data/nova/instances/58fede94-cddc-4a5c-b223-e1894250147e_del complete
Nov 08 20:17:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:51 user nova-compute[74638]: INFO nova.compute.manager [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Took 3.91 seconds to destroy the instance on the hypervisor.
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:17:51 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance destroyed successfully.
Nov 08 20:17:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-changed-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Refreshing instance network info cache due to event network-changed-d614c985-f857-4c70-8c85-978502f3d371. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] Acquiring lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] Acquired lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:17:51 user nova-compute[74638]: DEBUG nova.network.neutron [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Refreshing network info cache for port d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:52 user nova-compute[74638]: WARNING nova.compute.manager [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:52 user nova-compute[74638]: WARNING nova.compute.manager [req-59e53414-915f-4298-978a-300e9ec2eac7 req-54ab3005-4519-4069-a3a5-1989aaabdd7a service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updated VIF entry in instance network info cache for port d614c985-f857-4c70-8c85-978502f3d371. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] Releasing lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-changed-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Refreshing instance network info cache due to event network-changed-d614c985-f857-4c70-8c85-978502f3d371. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] Acquiring lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] Acquired lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:17:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Refreshing network info cache for port d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updated VIF entry in instance network info cache for port d614c985-f857-4c70-8c85-978502f3d371. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [{"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-39395d46-5048-46a8-869c-6bd04388a5fe req-f2f3ebd2-3403-453c-8d61-7deae3743611 service nova] Releasing lock "refresh_cache-1953f44c-b839-4515-a0b4-1212bfa93092" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-c712445e-1125-4072-b15b-37830e774198 req-a882dd13-73f6-4477-ba15-801a934a4703 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-deleted-ff9effc3-791c-4844-bfd7-3032135bb091 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:53 user nova-compute[74638]: INFO nova.compute.manager [req-c712445e-1125-4072-b15b-37830e774198 req-a882dd13-73f6-4477-ba15-801a934a4703 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Neutron deleted interface ff9effc3-791c-4844-bfd7-3032135bb091; detaching it from the instance and deleting it from the info cache
Nov 08 20:17:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-c712445e-1125-4072-b15b-37830e774198 req-a882dd13-73f6-4477-ba15-801a934a4703 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [{"id": "e2bfa746-5623-4be5-a820-87dcf5200be7", "address": "fa:16:3e:1b:ea:48", "network": {"id": "fbc3a46e-e1b9-4edd-8cc2-bf8cececcd50", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2109152312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bfa746-56", "ovs_interfaceid": "e2bfa746-5623-4be5-a820-87dcf5200be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-c712445e-1125-4072-b15b-37830e774198 req-a882dd13-73f6-4477-ba15-801a934a4703 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Detach interface failed, port_id=ff9effc3-791c-4844-bfd7-3032135bb091, reason: Instance 58fede94-cddc-4a5c-b223-e1894250147e could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:54 user nova-compute[74638]: WARNING nova.compute.manager [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:17:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:17:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:17:54 user nova-compute[74638]: WARNING nova.compute.manager [req-017651f6-fca3-46c2-bab4-5fd702ed4199 req-6de0beb1-21f3-4286-a950-752b77ff2b39 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:17:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-977db451-51f0-43e5-a92e-3767e7527ba4 req-71eb2aaf-5e33-41f2-a906-8602c01ded71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-deleted-e2bfa746-5623-4be5-a820-87dcf5200be7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:55 user nova-compute[74638]: INFO nova.compute.manager [req-977db451-51f0-43e5-a92e-3767e7527ba4 req-71eb2aaf-5e33-41f2-a906-8602c01ded71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Neutron deleted interface e2bfa746-5623-4be5-a820-87dcf5200be7; detaching it from the instance and deleting it from the info cache
Nov 08 20:17:55 user nova-compute[74638]: DEBUG nova.network.neutron [req-977db451-51f0-43e5-a92e-3767e7527ba4 req-71eb2aaf-5e33-41f2-a906-8602c01ded71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [{"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f446962d-48ce-4b5f-b105-d762c2338a0e", "address": "fa:16:3e:cc:40:cc", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf446962d-48", "ovs_interfaceid": "f446962d-48ce-4b5f-b105-d762c2338a0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-977db451-51f0-43e5-a92e-3767e7527ba4 req-71eb2aaf-5e33-41f2-a906-8602c01ded71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Detach interface failed, port_id=e2bfa746-5623-4be5-a820-87dcf5200be7, reason: Instance 58fede94-cddc-4a5c-b223-e1894250147e could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:17:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-977db451-51f0-43e5-a92e-3767e7527ba4 req-71eb2aaf-5e33-41f2-a906-8602c01ded71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-deleted-f446962d-48ce-4b5f-b105-d762c2338a0e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:55 user nova-compute[74638]: INFO nova.compute.manager [req-977db451-51f0-43e5-a92e-3767e7527ba4 req-71eb2aaf-5e33-41f2-a906-8602c01ded71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Neutron deleted interface f446962d-48ce-4b5f-b105-d762c2338a0e; detaching it from the instance and deleting it from the info cache
Nov 08 20:17:55 user nova-compute[74638]: DEBUG nova.network.neutron [req-977db451-51f0-43e5-a92e-3767e7527ba4 req-71eb2aaf-5e33-41f2-a906-8602c01ded71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [{"id": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "address": "fa:16:3e:5a:6c:18", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15ce325a-9c", "ovs_interfaceid": "15ce325a-9c59-41ab-b96a-c1da8bd15896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "address": "fa:16:3e:4a:a1:4e", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069fbd24-f2", "ovs_interfaceid": "069fbd24-f210-49d4-bf0e-28df125ddd0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "address": "fa:16:3e:72:a8:9f", "network": {"id": "ed1b29a9-70f6-4584-ac44-dd9db5f680bd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1961105050", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d00d838-5c", "ovs_interfaceid": "3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "address": "fa:16:3e:41:be:cf", "network": {"id": "c6a96616-0d8b-463e-9a73-57d925a5189b", "bridge": "br-int", "label": "tempest-device-tagging-net2-927044706", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77c8df0cff774621bc464646de80bbb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a858799-b2", "ovs_interfaceid": "2a858799-b2c0-421b-b998-8d229a9eb6d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-977db451-51f0-43e5-a92e-3767e7527ba4 req-71eb2aaf-5e33-41f2-a906-8602c01ded71 service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Detach interface failed, port_id=f446962d-48ce-4b5f-b105-d762c2338a0e, reason: Instance 58fede94-cddc-4a5c-b223-e1894250147e could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:17:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-63f35594-a482-4cb8-8bed-96c5631b1e03 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:17:56 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:17:56 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Took 5.64 seconds to deallocate network for instance.
Nov 08 20:17:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-b50f9f7f-a210-450b-99cf-edc4fa31af6e req-792129f8-cf15-4f42-97e9-232d7fe2fafd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-deleted-3d00d838-5c5c-46ba-8cda-f4d2b89a6d7f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-b50f9f7f-a210-450b-99cf-edc4fa31af6e req-792129f8-cf15-4f42-97e9-232d7fe2fafd service nova] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Received event network-vif-deleted-2a858799-b2c0-421b-b998-8d229a9eb6d9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:17:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:17:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:17:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:17:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:17:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:17:59 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updating instance_info_cache with network_info: [{"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-105b86cf-4f0f-4003-8407-42b945553b18" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "61243e09-42f2-4c57-8426-5aa54e0ad99a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:00 user nova-compute[74638]: INFO nova.compute.manager [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Terminating instance
Nov 08 20:18:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:00 user nova-compute[74638]: INFO nova.compute.manager [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] [instance: 58fede94-cddc-4a5c-b223-e1894250147e] Took 3.48 seconds to detach 3 volumes for instance.
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-608719f5-a413-4e9f-a336-dc71a93957b7 req-9c346e52-33b2-49ff-bb53-2873a26fb8d2 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received event network-vif-unplugged-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-608719f5-a413-4e9f-a336-dc71a93957b7 req-9c346e52-33b2-49ff-bb53-2873a26fb8d2 service nova] Acquiring lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-608719f5-a413-4e9f-a336-dc71a93957b7 req-9c346e52-33b2-49ff-bb53-2873a26fb8d2 service nova] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-608719f5-a413-4e9f-a336-dc71a93957b7 req-9c346e52-33b2-49ff-bb53-2873a26fb8d2 service nova] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-608719f5-a413-4e9f-a336-dc71a93957b7 req-9c346e52-33b2-49ff-bb53-2873a26fb8d2 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] No waiting events found dispatching network-vif-unplugged-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:18:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-608719f5-a413-4e9f-a336-dc71a93957b7 req-9c346e52-33b2-49ff-bb53-2873a26fb8d2 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received event network-vif-unplugged-4f8220ef-e09d-4236-82f0-9996f4313d85 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:01 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Instance destroyed successfully.
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.objects.instance [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lazy-loading 'resources' on Instance uuid 61243e09-42f2-4c57-8426-5aa54e0ad99a {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1235473174',display_name='tempest-VolumesAdminNegativeTest-server-1235473174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1235473174',id=20,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335d8305b8bf4f3c8083aabe8768c906',ramdisk_id='',reservation_id='r-xl3vxyaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1731747303',owner_user_name='tempest-VolumesAdminNegativeTest-1731747303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:15:57Z,user_data=None,user_id='fa581d9fbb664526bfabb540888b2779',uuid=61243e09-42f2-4c57-8426-5aa54e0ad99a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converting VIF {"id": "4f8220ef-e09d-4236-82f0-9996f4313d85", "address": "fa:16:3e:e3:2c:fb", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8220ef-e0", "ovs_interfaceid": "4f8220ef-e09d-4236-82f0-9996f4313d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:fb,bridge_name='br-int',has_traffic_filtering=True,id=4f8220ef-e09d-4236-82f0-9996f4313d85,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8220ef-e0') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG os_vif [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:fb,bridge_name='br-int',has_traffic_filtering=True,id=4f8220ef-e09d-4236-82f0-9996f4313d85,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8220ef-e0') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f8220ef-e0, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a0174a9-6063-4e94-9aad-6e0599d9b470) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:18:01 user nova-compute[74638]: INFO os_vif [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:2c:fb,bridge_name='br-int',has_traffic_filtering=True,id=4f8220ef-e09d-4236-82f0-9996f4313d85,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8220ef-e0')
Nov 08 20:18:01 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Deleting instance files /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a_del
Nov 08 20:18:01 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Deletion of /opt/stack/data/nova/instances/61243e09-42f2-4c57-8426-5aa54e0ad99a_del complete
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:18:01 user nova-compute[74638]: INFO nova.compute.manager [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 08 20:18:01 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:01 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Deleted allocations for instance 58fede94-cddc-4a5c-b223-e1894250147e
Nov 08 20:18:01 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:18:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9fb26dee-7e52-42bf-863d-a208ded997fc tempest-TaggedBootDevicesTest_v242-1950450066 tempest-TaggedBootDevicesTest_v242-1950450066-project-member] Lock "58fede94-cddc-4a5c-b223-e1894250147e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.191s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG nova.compute.manager [req-5da17255-ef01-4af3-9b81-f454c8e61a16 req-942cd8ec-86f6-4f02-95ee-716cba401519 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received event network-vif-deleted-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:02 user nova-compute[74638]: INFO nova.compute.manager [req-5da17255-ef01-4af3-9b81-f454c8e61a16 req-942cd8ec-86f6-4f02-95ee-716cba401519 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Neutron deleted interface 4f8220ef-e09d-4236-82f0-9996f4313d85; detaching it from the instance and deleting it from the info cache
Nov 08 20:18:02 user nova-compute[74638]: DEBUG nova.network.neutron [req-5da17255-ef01-4af3-9b81-f454c8e61a16 req-942cd8ec-86f6-4f02-95ee-716cba401519 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:02 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Took 0.66 seconds to deallocate network for instance.
Nov 08 20:18:02 user nova-compute[74638]: DEBUG nova.compute.manager [req-5da17255-ef01-4af3-9b81-f454c8e61a16 req-942cd8ec-86f6-4f02-95ee-716cba401519 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Detach interface failed, port_id=4f8220ef-e09d-4236-82f0-9996f4313d85, reason: Instance 61243e09-42f2-4c57-8426-5aa54e0ad99a could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:02 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Deleted allocations for instance 61243e09-42f2-4c57-8426-5aa54e0ad99a
Nov 08 20:18:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eba2eec-89aa-4767-a5b9-ae83e9fc6445 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-ede63b8c-183d-441c-bf8c-4f36e945327e req-7d1fdc28-0620-469f-96aa-cca8993486f8 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received event network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ede63b8c-183d-441c-bf8c-4f36e945327e req-7d1fdc28-0620-469f-96aa-cca8993486f8 service nova] Acquiring lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ede63b8c-183d-441c-bf8c-4f36e945327e req-7d1fdc28-0620-469f-96aa-cca8993486f8 service nova] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ede63b8c-183d-441c-bf8c-4f36e945327e req-7d1fdc28-0620-469f-96aa-cca8993486f8 service nova] Lock "61243e09-42f2-4c57-8426-5aa54e0ad99a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-ede63b8c-183d-441c-bf8c-4f36e945327e req-7d1fdc28-0620-469f-96aa-cca8993486f8 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] No waiting events found dispatching network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:18:03 user nova-compute[74638]: WARNING nova.compute.manager [req-ede63b8c-183d-441c-bf8c-4f36e945327e req-7d1fdc28-0620-469f-96aa-cca8993486f8 service nova] [instance: 61243e09-42f2-4c57-8426-5aa54e0ad99a] Received unexpected event network-vif-plugged-4f8220ef-e09d-4236-82f0-9996f4313d85 for instance with vm_state deleted and task_state None.
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:18:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8138MB free_disk=25.453235626220703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 1953f44c-b839-4515-a0b4-1212bfa93092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 105b86cf-4f0f-4003-8407-42b945553b18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:18:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:18:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:18:17 user nova-compute[74638]: INFO nova.compute.claims [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Claim successful on node user
Nov 08 20:18:18 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG nova.network.neutron [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:18:18 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:18:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:18 user nova-compute[74638]: INFO nova.virt.block_device [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Booting with volume 30e7f9f1-0309-4a06-8485-93af26b5674b at /dev/vda
Nov 08 20:18:18 user nova-compute[74638]: DEBUG nova.policy [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc302495f45a4ae1bd2524aa60ecbc85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0b2492206349f197739ee10c95a28f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG os_brick.utils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d2afbc-1abf-45be-a6e7-a8d0c2531b16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617314f-3beb-41dd-9a5a-93ca4f456d98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[798659d2-b000-4669-8f15-e4511c4b81d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3a2d15-0d43-421d-a5db-c0e1f4319f0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:18:18 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:18:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[42231ff0-52a6-4fa6-897c-d80cf61152cb]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG os_brick.utils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:18:18 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating existing volume attachment record: 3880a1f5-374b-4816-a6c7-002a7b33bd91 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Successfully created port: f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:18:20 user nova-compute[74638]: INFO nova.compute.claims [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Claim successful on node user
Nov 08 20:18:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:18:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Successfully updated port: f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:18:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-d4cfe8bb-c5c8-4386-a503-0b060afdd807 req-ff979410-132e-4c4a-82ed-4a4908c1828b service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-changed-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-d4cfe8bb-c5c8-4386-a503-0b060afdd807 req-ff979410-132e-4c4a-82ed-4a4908c1828b service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Refreshing instance network info cache due to event network-changed-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d4cfe8bb-c5c8-4386-a503-0b060afdd807 req-ff979410-132e-4c4a-82ed-4a4908c1828b service nova] Acquiring lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d4cfe8bb-c5c8-4386-a503-0b060afdd807 req-ff979410-132e-4c4a-82ed-4a4908c1828b service nova] Acquired lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.network.neutron [req-d4cfe8bb-c5c8-4386-a503-0b060afdd807 req-ff979410-132e-4c4a-82ed-4a4908c1828b service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Refreshing network info cache for port f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.policy [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b75bc3e9142b4bf6a314dc12b7a42bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6b297f1c394c5d84966b543d7a9cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.network.neutron [req-d4cfe8bb-c5c8-4386-a503-0b060afdd807 req-ff979410-132e-4c4a-82ed-4a4908c1828b service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:18:21 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Creating image(s)
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "/opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "/opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.network.neutron [req-d4cfe8bb-c5c8-4386-a503-0b060afdd807 req-ff979410-132e-4c4a-82ed-4a4908c1828b service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d4cfe8bb-c5c8-4386-a503-0b060afdd807 req-ff979410-132e-4c4a-82ed-4a4908c1828b service nova] Releasing lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquired lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.network.neutron [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.235s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.network.neutron [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.229s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk 1073741824" returned: 0 in 0.069s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.216s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:18:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Successfully created port: 20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating instance_info_cache with network_info: [{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Releasing lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance network_info: |[{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Cannot resize image /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Ensure instance console log exists: /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Successfully updated port: 20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquired lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:18:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-8793a760-3fb8-445e-88fe-102099f0ce45 req-f2778c6e-7c53-43ea-b5d9-762eb95d63dd service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received event network-changed-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-8793a760-3fb8-445e-88fe-102099f0ce45 req-f2778c6e-7c53-43ea-b5d9-762eb95d63dd service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Refreshing instance network info cache due to event network-changed-20297004-c8b7-4d79-865d-dd041c9178d2. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8793a760-3fb8-445e-88fe-102099f0ce45 req-f2778c6e-7c53-43ea-b5d9-762eb95d63dd service nova] Acquiring lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updating instance_info_cache with network_info: [{"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Releasing lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Instance network_info: |[{"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8793a760-3fb8-445e-88fe-102099f0ce45 req-f2778c6e-7c53-43ea-b5d9-762eb95d63dd service nova] Acquired lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.network.neutron [req-8793a760-3fb8-445e-88fe-102099f0ce45 req-f2778c6e-7c53-43ea-b5d9-762eb95d63dd service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Refreshing network info cache for port 20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Start _get_guest_xml network_info=[{"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:18:23 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:18:23 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1275336976',display_name='tempest-AttachVolumeTestJSON-server-1275336976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1275336976',id=22,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzVWacjKCXRQCU3Yw1AeIjIzDu26YvmMM1hPkvudwvEWb9WLuUTLntI59CD8+v5+qzHMsYorp0hetH7W21lnUtJZWBQKxpQHfiUlRjNeACm0VTvew3G/3sF6rnXBJkwHA==',key_name='tempest-keypair-88583300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-tm3ka2wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:18:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=5ec97bac-185e-4959-b763-6514faef8e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:22:68,bridge_name='br-int',has_traffic_filtering=True,id=20297004-c8b7-4d79-865d-dd041c9178d2,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20297004-c8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.objects.instance [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:18:23 user nova-compute[74638]:   <uuid>5ec97bac-185e-4959-b763-6514faef8e5d</uuid>
Nov 08 20:18:23 user nova-compute[74638]:   <name>instance-00000016</name>
Nov 08 20:18:23 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:18:23 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:18:23 user nova-compute[74638]:   <metadata>
Nov 08 20:18:23 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:18:23 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:18:23 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeTestJSON-server-1275336976</nova:name>
Nov 08 20:18:23 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:18:23</nova:creationTime>
Nov 08 20:18:23 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:18:23 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:18:23 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:18:23 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:18:23 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:18:23 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:18:23 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:18:23 user nova-compute[74638]:       <nova:owner>
Nov 08 20:18:23 user nova-compute[74638]:         <nova:user uuid="b75bc3e9142b4bf6a314dc12b7a42bbe">tempest-AttachVolumeTestJSON-1773867302-project-member</nova:user>
Nov 08 20:18:23 user nova-compute[74638]:         <nova:project uuid="3b6b297f1c394c5d84966b543d7a9cc6">tempest-AttachVolumeTestJSON-1773867302</nova:project>
Nov 08 20:18:23 user nova-compute[74638]:       </nova:owner>
Nov 08 20:18:23 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:18:23 user nova-compute[74638]:       <nova:ports>
Nov 08 20:18:23 user nova-compute[74638]:         <nova:port uuid="20297004-c8b7-4d79-865d-dd041c9178d2">
Nov 08 20:18:23 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 20:18:23 user nova-compute[74638]:         </nova:port>
Nov 08 20:18:23 user nova-compute[74638]:       </nova:ports>
Nov 08 20:18:23 user nova-compute[74638]:     </nova:instance>
Nov 08 20:18:23 user nova-compute[74638]:   </metadata>
Nov 08 20:18:23 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:18:23 user nova-compute[74638]:     <system>
Nov 08 20:18:23 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:18:23 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:18:23 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:18:23 user nova-compute[74638]:       <entry name="serial">5ec97bac-185e-4959-b763-6514faef8e5d</entry>
Nov 08 20:18:23 user nova-compute[74638]:       <entry name="uuid">5ec97bac-185e-4959-b763-6514faef8e5d</entry>
Nov 08 20:18:23 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:18:23 user nova-compute[74638]:     </system>
Nov 08 20:18:23 user nova-compute[74638]:   </sysinfo>
Nov 08 20:18:23 user nova-compute[74638]:   <os>
Nov 08 20:18:23 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:18:23 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:18:23 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:18:23 user nova-compute[74638]:   </os>
Nov 08 20:18:23 user nova-compute[74638]:   <features>
Nov 08 20:18:23 user nova-compute[74638]:     <acpi/>
Nov 08 20:18:23 user nova-compute[74638]:     <apic/>
Nov 08 20:18:23 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:18:23 user nova-compute[74638]:   </features>
Nov 08 20:18:23 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:18:23 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:18:23 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:18:23 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:18:23 user nova-compute[74638]:   </clock>
Nov 08 20:18:23 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:18:23 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:18:23 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:18:23 user nova-compute[74638]:   </cpu>
Nov 08 20:18:23 user nova-compute[74638]:   <devices>
Nov 08 20:18:23 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:18:23 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:18:23 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk"/>
Nov 08 20:18:23 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:18:23 user nova-compute[74638]:     </disk>
Nov 08 20:18:23 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:18:23 user nova-compute[74638]:       <mac address="fa:16:3e:1a:22:68"/>
Nov 08 20:18:23 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:18:23 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:18:23 user nova-compute[74638]:       <target dev="tap20297004-c8"/>
Nov 08 20:18:23 user nova-compute[74638]:     </interface>
Nov 08 20:18:23 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:18:23 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/console.log" append="off"/>
Nov 08 20:18:23 user nova-compute[74638]:     </serial>
Nov 08 20:18:23 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:18:23 user nova-compute[74638]:     <video>
Nov 08 20:18:23 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:18:23 user nova-compute[74638]:     </video>
Nov 08 20:18:23 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:18:23 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:18:23 user nova-compute[74638]:     </rng>
Nov 08 20:18:23 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:18:23 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:18:23 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:18:23 user nova-compute[74638]:     </memballoon>
Nov 08 20:18:23 user nova-compute[74638]:   </devices>
Nov 08 20:18:23 user nova-compute[74638]: </domain>
Nov 08 20:18:23 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1275336976',display_name='tempest-AttachVolumeTestJSON-server-1275336976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1275336976',id=22,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzVWacjKCXRQCU3Yw1AeIjIzDu26YvmMM1hPkvudwvEWb9WLuUTLntI59CD8+v5+qzHMsYorp0hetH7W21lnUtJZWBQKxpQHfiUlRjNeACm0VTvew3G/3sF6rnXBJkwHA==',key_name='tempest-keypair-88583300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-tm3ka2wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:18:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=5ec97bac-185e-4959-b763-6514faef8e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:22:68,bridge_name='br-int',has_traffic_filtering=True,id=20297004-c8b7-4d79-865d-dd041c9178d2,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20297004-c8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG os_vif [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:22:68,bridge_name='br-int',has_traffic_filtering=True,id=20297004-c8b7-4d79-865d-dd041c9178d2,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20297004-c8') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b722a564-ed6c-5f51-a26d-ebb57261d81a', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20297004-c8, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20297004-c8, col_values=(('qos', UUID('6e981e08-500e-433b-9761-35caa86b324e')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20297004-c8, col_values=(('external_ids', {'iface-id': '20297004-c8b7-4d79-865d-dd041c9178d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:22:68', 'vm-uuid': '5ec97bac-185e-4959-b763-6514faef8e5d'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:23 user nova-compute[74638]: INFO os_vif [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:22:68,bridge_name='br-int',has_traffic_filtering=True,id=20297004-c8b7-4d79-865d-dd041c9178d2,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20297004-c8')
Nov 08 20:18:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:18:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No VIF found with MAC fa:16:3e:1a:22:68, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:18:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:24 user nova-compute[74638]: INFO nova.compute.manager [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Detaching volume 37b60297-5e78-4627-bc71-24a98e393066
Nov 08 20:18:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-8793a760-3fb8-445e-88fe-102099f0ce45 req-f2778c6e-7c53-43ea-b5d9-762eb95d63dd service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updated VIF entry in instance network info cache for port 20297004-c8b7-4d79-865d-dd041c9178d2. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:18:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-8793a760-3fb8-445e-88fe-102099f0ce45 req-f2778c6e-7c53-43ea-b5d9-762eb95d63dd service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updating instance_info_cache with network_info: [{"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8793a760-3fb8-445e-88fe-102099f0ce45 req-f2778c6e-7c53-43ea-b5d9-762eb95d63dd service nova] Releasing lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:18:24 user nova-compute[74638]: INFO nova.virt.block_device [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Attempting to driver detach volume 37b60297-5e78-4627-bc71-24a98e393066 from mountpoint /dev/vdb
Nov 08 20:18:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Attempting to detach device vdb from instance 1953f44c-b839-4515-a0b4-1212bfa93092 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:18:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:18:24 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:18:24 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:18:24 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:18:24 user nova-compute[74638]:   <serial>37b60297-5e78-4627-bc71-24a98e393066</serial>
Nov 08 20:18:24 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:18:24 user nova-compute[74638]: </disk>
Nov 08 20:18:24 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:18:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Successfully detached device vdb from instance 1953f44c-b839-4515-a0b4-1212bfa93092 from the persistent domain config.
Nov 08 20:18:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1953f44c-b839-4515-a0b4-1212bfa93092 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:18:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:18:24 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:18:24 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:18:24 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:18:24 user nova-compute[74638]:   <serial>37b60297-5e78-4627-bc71-24a98e393066</serial>
Nov 08 20:18:24 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:18:24 user nova-compute[74638]: </disk>
Nov 08 20:18:24 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:18:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-200a9787-5c57-4dfa-a6b7-7d1c96a195b8 req-6bf21df2-d0cb-4049-8646-a871d05b7177 service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received event network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-200a9787-5c57-4dfa-a6b7-7d1c96a195b8 req-6bf21df2-d0cb-4049-8646-a871d05b7177 service nova] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-200a9787-5c57-4dfa-a6b7-7d1c96a195b8 req-6bf21df2-d0cb-4049-8646-a871d05b7177 service nova] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-200a9787-5c57-4dfa-a6b7-7d1c96a195b8 req-6bf21df2-d0cb-4049-8646-a871d05b7177 service nova] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-200a9787-5c57-4dfa-a6b7-7d1c96a195b8 req-6bf21df2-d0cb-4049-8646-a871d05b7177 service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] No waiting events found dispatching network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:18:25 user nova-compute[74638]: WARNING nova.compute.manager [req-200a9787-5c57-4dfa-a6b7-7d1c96a195b8 req-6bf21df2-d0cb-4049-8646-a871d05b7177 service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received unexpected event network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 for instance with vm_state building and task_state spawning.
Nov 08 20:18:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-65cef210-0ab3-4688-b3a1-9577e16c7bf0 req-4128c80d-7222-48f6-a65a-3610d644a34f service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received event network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65cef210-0ab3-4688-b3a1-9577e16c7bf0 req-4128c80d-7222-48f6-a65a-3610d644a34f service nova] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65cef210-0ab3-4688-b3a1-9577e16c7bf0 req-4128c80d-7222-48f6-a65a-3610d644a34f service nova] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65cef210-0ab3-4688-b3a1-9577e16c7bf0 req-4128c80d-7222-48f6-a65a-3610d644a34f service nova] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-65cef210-0ab3-4688-b3a1-9577e16c7bf0 req-4128c80d-7222-48f6-a65a-3610d644a34f service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] No waiting events found dispatching network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:18:27 user nova-compute[74638]: WARNING nova.compute.manager [req-65cef210-0ab3-4688-b3a1-9577e16c7bf0 req-4128c80d-7222-48f6-a65a-3610d644a34f service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received unexpected event network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 for instance with vm_state building and task_state spawning.
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:18:27 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Instance spawned successfully.
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:28 user nova-compute[74638]: INFO nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:18:28 user nova-compute[74638]: INFO nova.compute.manager [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Took 7.91 seconds to build instance.
Nov 08 20:18:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-08e818ee-2a13-49f0-8a5f-4173375de878 tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.057s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:18:28 user nova-compute[74638]: INFO nova.compute.claims [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Claim successful on node user
Nov 08 20:18:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:18:28 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:18:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG nova.policy [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '875fdd7768654b8e8c261749bbb1c78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a945ba0f2d41aa9cd7ad8dfd3ea0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:18:29 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Creating image(s)
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "/opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "/opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "/opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.244s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.212s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk 1073741824" returned: 0 in 0.069s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Successfully created port: 84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.237s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:18:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Cannot resize image /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Ensure instance console log exists: /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Successfully updated port: 84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquired lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-ae1a10e7-8c1a-4032-8e72-3f1cd96035c1 req-3acab0ff-9350-4d3c-9968-8825e816285f service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received event network-changed-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-ae1a10e7-8c1a-4032-8e72-3f1cd96035c1 req-3acab0ff-9350-4d3c-9968-8825e816285f service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Refreshing instance network info cache due to event network-changed-84c5fdc8-faae-454a-9a74-a9ff4bd3136c. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ae1a10e7-8c1a-4032-8e72-3f1cd96035c1 req-3acab0ff-9350-4d3c-9968-8825e816285f service nova] Acquiring lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:18:30 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Updating instance_info_cache with network_info: [{"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Releasing lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Instance network_info: |[{"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ae1a10e7-8c1a-4032-8e72-3f1cd96035c1 req-3acab0ff-9350-4d3c-9968-8825e816285f service nova] Acquired lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.network.neutron [req-ae1a10e7-8c1a-4032-8e72-3f1cd96035c1 req-3acab0ff-9350-4d3c-9968-8825e816285f service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Refreshing network info cache for port 84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Start _get_guest_xml network_info=[{"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:18:31 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:18:31 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-83666426',display_name='tempest-VolumesSnapshotTestJSON-instance-83666426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-83666426',id=23,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxnfxmWR7JsWnArFl6p64rxl6Mc65y/e6wo7gK8AMHUygLFUKVRg2UKyBDokPYtFaszCk67fRnpsYXaOtmSlRFFItDxoLZbTbNXxryinDqifp+SBx4+MlJ5+YoJoYZsLQ==',key_name='tempest-keypair-1914665983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a945ba0f2d41aa9cd7ad8dfd3ea0a3',ramdisk_id='',reservation_id='r-81wikjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1022894138',owner_user_name='tempest-VolumesSnapshotTestJSON-1022894138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875fdd7768654b8e8c261749bbb1c78e',uuid=854bd78e-f3a1-4711-b880-56b0787eddf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converting VIF {"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:18:95,bridge_name='br-int',has_traffic_filtering=True,id=84c5fdc8-faae-454a-9a74-a9ff4bd3136c,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5fdc8-fa') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.objects.instance [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'pci_devices' on Instance uuid 854bd78e-f3a1-4711-b880-56b0787eddf6 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:18:31 user nova-compute[74638]:   <uuid>854bd78e-f3a1-4711-b880-56b0787eddf6</uuid>
Nov 08 20:18:31 user nova-compute[74638]:   <name>instance-00000017</name>
Nov 08 20:18:31 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:18:31 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:18:31 user nova-compute[74638]:   <metadata>
Nov 08 20:18:31 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:18:31 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:18:31 user nova-compute[74638]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-83666426</nova:name>
Nov 08 20:18:31 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:18:31</nova:creationTime>
Nov 08 20:18:31 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:18:31 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:18:31 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:18:31 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:18:31 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:18:31 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:18:31 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:18:31 user nova-compute[74638]:       <nova:owner>
Nov 08 20:18:31 user nova-compute[74638]:         <nova:user uuid="875fdd7768654b8e8c261749bbb1c78e">tempest-VolumesSnapshotTestJSON-1022894138-project-member</nova:user>
Nov 08 20:18:31 user nova-compute[74638]:         <nova:project uuid="e6a945ba0f2d41aa9cd7ad8dfd3ea0a3">tempest-VolumesSnapshotTestJSON-1022894138</nova:project>
Nov 08 20:18:31 user nova-compute[74638]:       </nova:owner>
Nov 08 20:18:31 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:18:31 user nova-compute[74638]:       <nova:ports>
Nov 08 20:18:31 user nova-compute[74638]:         <nova:port uuid="84c5fdc8-faae-454a-9a74-a9ff4bd3136c">
Nov 08 20:18:31 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:18:31 user nova-compute[74638]:         </nova:port>
Nov 08 20:18:31 user nova-compute[74638]:       </nova:ports>
Nov 08 20:18:31 user nova-compute[74638]:     </nova:instance>
Nov 08 20:18:31 user nova-compute[74638]:   </metadata>
Nov 08 20:18:31 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:18:31 user nova-compute[74638]:     <system>
Nov 08 20:18:31 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:18:31 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:18:31 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:18:31 user nova-compute[74638]:       <entry name="serial">854bd78e-f3a1-4711-b880-56b0787eddf6</entry>
Nov 08 20:18:31 user nova-compute[74638]:       <entry name="uuid">854bd78e-f3a1-4711-b880-56b0787eddf6</entry>
Nov 08 20:18:31 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:18:31 user nova-compute[74638]:     </system>
Nov 08 20:18:31 user nova-compute[74638]:   </sysinfo>
Nov 08 20:18:31 user nova-compute[74638]:   <os>
Nov 08 20:18:31 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:18:31 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:18:31 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:18:31 user nova-compute[74638]:   </os>
Nov 08 20:18:31 user nova-compute[74638]:   <features>
Nov 08 20:18:31 user nova-compute[74638]:     <acpi/>
Nov 08 20:18:31 user nova-compute[74638]:     <apic/>
Nov 08 20:18:31 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:18:31 user nova-compute[74638]:   </features>
Nov 08 20:18:31 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:18:31 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:18:31 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:18:31 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:18:31 user nova-compute[74638]:   </clock>
Nov 08 20:18:31 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:18:31 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:18:31 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:18:31 user nova-compute[74638]:   </cpu>
Nov 08 20:18:31 user nova-compute[74638]:   <devices>
Nov 08 20:18:31 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:18:31 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:18:31 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk"/>
Nov 08 20:18:31 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:18:31 user nova-compute[74638]:     </disk>
Nov 08 20:18:31 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:18:31 user nova-compute[74638]:       <mac address="fa:16:3e:aa:18:95"/>
Nov 08 20:18:31 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:18:31 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:18:31 user nova-compute[74638]:       <target dev="tap84c5fdc8-fa"/>
Nov 08 20:18:31 user nova-compute[74638]:     </interface>
Nov 08 20:18:31 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:18:31 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/console.log" append="off"/>
Nov 08 20:18:31 user nova-compute[74638]:     </serial>
Nov 08 20:18:31 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:18:31 user nova-compute[74638]:     <video>
Nov 08 20:18:31 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:18:31 user nova-compute[74638]:     </video>
Nov 08 20:18:31 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:18:31 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:18:31 user nova-compute[74638]:     </rng>
Nov 08 20:18:31 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:18:31 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:18:31 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:18:31 user nova-compute[74638]:     </memballoon>
Nov 08 20:18:31 user nova-compute[74638]:   </devices>
Nov 08 20:18:31 user nova-compute[74638]: </domain>
Nov 08 20:18:31 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-83666426',display_name='tempest-VolumesSnapshotTestJSON-instance-83666426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-83666426',id=23,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxnfxmWR7JsWnArFl6p64rxl6Mc65y/e6wo7gK8AMHUygLFUKVRg2UKyBDokPYtFaszCk67fRnpsYXaOtmSlRFFItDxoLZbTbNXxryinDqifp+SBx4+MlJ5+YoJoYZsLQ==',key_name='tempest-keypair-1914665983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a945ba0f2d41aa9cd7ad8dfd3ea0a3',ramdisk_id='',reservation_id='r-81wikjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1022894138',owner_user_name='tempest-VolumesSnapshotTestJSON-1022894138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875fdd7768654b8e8c261749bbb1c78e',uuid=854bd78e-f3a1-4711-b880-56b0787eddf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converting VIF {"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:18:95,bridge_name='br-int',has_traffic_filtering=True,id=84c5fdc8-faae-454a-9a74-a9ff4bd3136c,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5fdc8-fa') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG os_vif [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:18:95,bridge_name='br-int',has_traffic_filtering=True,id=84c5fdc8-faae-454a-9a74-a9ff4bd3136c,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5fdc8-fa') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3634fe05-4c1c-545a-ad1d-152fc069c2a2', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c5fdc8-fa, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c5fdc8-fa, col_values=(('qos', UUID('5b35f2f8-7f54-4efc-8506-041fc9c07f47')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c5fdc8-fa, col_values=(('external_ids', {'iface-id': '84c5fdc8-faae-454a-9a74-a9ff4bd3136c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:18:95', 'vm-uuid': '854bd78e-f3a1-4711-b880-56b0787eddf6'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:31 user nova-compute[74638]: INFO os_vif [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:18:95,bridge_name='br-int',has_traffic_filtering=True,id=84c5fdc8-faae-454a-9a74-a9ff4bd3136c,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5fdc8-fa')
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No VIF found with MAC fa:16:3e:aa:18:95, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.network.neutron [req-ae1a10e7-8c1a-4032-8e72-3f1cd96035c1 req-3acab0ff-9350-4d3c-9968-8825e816285f service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Updated VIF entry in instance network info cache for port 84c5fdc8-faae-454a-9a74-a9ff4bd3136c. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG nova.network.neutron [req-ae1a10e7-8c1a-4032-8e72-3f1cd96035c1 req-3acab0ff-9350-4d3c-9968-8825e816285f service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Updating instance_info_cache with network_info: [{"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:18:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ae1a10e7-8c1a-4032-8e72-3f1cd96035c1 req-3acab0ff-9350-4d3c-9968-8825e816285f service nova] Releasing lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-915eb88d-6c88-47e4-8283-be819b570fdc req-16fd5d90-484b-4ef8-bd26-730db5a1432f service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received event network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-915eb88d-6c88-47e4-8283-be819b570fdc req-16fd5d90-484b-4ef8-bd26-730db5a1432f service nova] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-915eb88d-6c88-47e4-8283-be819b570fdc req-16fd5d90-484b-4ef8-bd26-730db5a1432f service nova] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-915eb88d-6c88-47e4-8283-be819b570fdc req-16fd5d90-484b-4ef8-bd26-730db5a1432f service nova] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-915eb88d-6c88-47e4-8283-be819b570fdc req-16fd5d90-484b-4ef8-bd26-730db5a1432f service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] No waiting events found dispatching network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:18:33 user nova-compute[74638]: WARNING nova.compute.manager [req-915eb88d-6c88-47e4-8283-be819b570fdc req-16fd5d90-484b-4ef8-bd26-730db5a1432f service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received unexpected event network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c for instance with vm_state building and task_state spawning.
Nov 08 20:18:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-0077b807-f220-4cef-a098-4cfadccaa583 req-0d346e68-7754-429f-9f4b-13bf3d187c61 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received event network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0077b807-f220-4cef-a098-4cfadccaa583 req-0d346e68-7754-429f-9f4b-13bf3d187c61 service nova] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0077b807-f220-4cef-a098-4cfadccaa583 req-0d346e68-7754-429f-9f4b-13bf3d187c61 service nova] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0077b807-f220-4cef-a098-4cfadccaa583 req-0d346e68-7754-429f-9f4b-13bf3d187c61 service nova] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.compute.manager [req-0077b807-f220-4cef-a098-4cfadccaa583 req-0d346e68-7754-429f-9f4b-13bf3d187c61 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] No waiting events found dispatching network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:18:35 user nova-compute[74638]: WARNING nova.compute.manager [req-0077b807-f220-4cef-a098-4cfadccaa583 req-0d346e68-7754-429f-9f4b-13bf3d187c61 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received unexpected event network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c for instance with vm_state building and task_state spawning.
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:18:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Instance spawned successfully.
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:35 user nova-compute[74638]: INFO nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 08 20:18:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:18:35 user nova-compute[74638]: INFO nova.compute.manager [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Took 7.64 seconds to build instance.
Nov 08 20:18:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b6ac62c2-3532-483c-9a23-917980a75a70 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.776s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:44 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1953f44c-b839-4515-a0b4-1212bfa93092 is timed out.
Nov 08 20:18:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Successfully detached device vdb from instance 1953f44c-b839-4515-a0b4-1212bfa93092 from the live domain config.
Nov 08 20:18:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTrIklyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:18:44 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b096e57-194d-4680-a791-1dac0ae4a356]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:18:44 user nova-compute[74638]: No targets found.
Nov 08 20:18:44 user nova-compute[74638]: iSNS:
Nov 08 20:18:44 user nova-compute[74638]: No targets found.
Nov 08 20:18:44 user nova-compute[74638]: STATIC:
Nov 08 20:18:44 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066
Nov 08 20:18:44 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:18:44 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:18:44 user nova-compute[74638]: FIRMWARE:
Nov 08 20:18:44 user nova-compute[74638]: No targets found.
Nov 08 20:18:44 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:18:44 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:18:44 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04a4bbf-40b8-46f9-accf-6715b53d94dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b10936-0cf5-4920-91a8-6a9d303ce5ae]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:18:44 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 (non-flash)
Nov 08 20:18:44 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54de59c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7c481-fcde-45c9-b1b8-41096f5689ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacff550-6b11-4285-a2fc-13e21c4811ed]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba919f8-44a0-4ab1-a355-7454f4b07831]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b143bf8c-142d-4633-9ee0-1123b87e809c]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b306f00-0167-4863-a2dc-4ef69e2f095f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34103f2-9964-471c-a4c3-6134e38e4de7]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066, portal: 172.16.0.220,3260]
Nov 08 20:18:45 user nova-compute[74638]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066, portal: 172.16.0.220,3260] successful.
Nov 08 20:18:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b60297-5e78-4627-bc71-24a98e393066 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05972e8-86c8-4e15-94a2-6cd16131d040]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] <== disconnect_volume: return (318ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:18:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'flavor' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-846e6a2b-2ec4-43aa-a930-c7e7c82c17d3 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.254s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:18:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Creating image(s)
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Ensure instance console log exists: /opt/stack/data/nova/instances/491aafd0-a4dd-4cb2-9584-e88c39367878/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Start _get_guest_xml network_info=[{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '3880a1f5-374b-4816-a6c7-002a7b33bd91', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJThDUgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '491aafd0-a4dd-4cb2-9584-e88c39367878', 'attached_at': '', 'detached_at': '', 'volume_id': '30e7f9f1-0309-4a06-8485-93af26b5674b', 'serial': '30e7f9f1-0309-4a06-8485-93af26b5674b'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:18:46 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:18:46 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJThDUgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:18:46 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:18:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:18:46 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:18:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:18:46 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f644b243-831b-421b-adf8-14d245adb09f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:18:46 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc47823-c27b-4638-beb8-feaf2cff4e65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b] added
Nov 08 20:18:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eabe54-338b-4830-9150-9f6ab9e20054]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[841e9c81-b7be-4c51-883e-2da49703becc]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJThDUgx {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJThDUgx" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[94714188-9098-4dd8-87b3-5471ebb9282c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJThDUgx'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[786bf5c2-05c1-42c3-aac7-7887d94be7a2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff74810-fb60-4c48-994b-73f6f00c0984]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:18:47 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:18:47 user nova-compute[74638]:  {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:18:47 user nova-compute[74638]: WARNING os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 20:18:47 user nova-compute[74638]: 
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[080bc801-532c-438b-8e7e-80d263a263bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260]
Nov 08 20:18:47 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260] successful.
Nov 08 20:18:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d01e6f7-fee1-4731-a482-413d0b1a05fa]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[31553371-66f5-484a-8815-0cbc70feaa11]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:18:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:18:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c219fd35-86e0-4cd6-8ce9-858a50ce4bd1]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:18:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJThDUgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23836643330333462', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836643330333462', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-912749548',display_name='tempest-ServerActionsTestOtherA-server-912749548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-912749548',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-qrmph4tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=491aafd0-a4dd-4cb2-9584-e88c39367878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.objects.instance [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'pci_devices' on Instance uuid 491aafd0-a4dd-4cb2-9584-e88c39367878 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:18:48 user nova-compute[74638]:   <uuid>491aafd0-a4dd-4cb2-9584-e88c39367878</uuid>
Nov 08 20:18:48 user nova-compute[74638]:   <name>instance-00000015</name>
Nov 08 20:18:48 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:18:48 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:18:48 user nova-compute[74638]:   <metadata>
Nov 08 20:18:48 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:18:48 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:18:48 user nova-compute[74638]:       <nova:name>tempest-ServerActionsTestOtherA-server-912749548</nova:name>
Nov 08 20:18:48 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:18:46</nova:creationTime>
Nov 08 20:18:48 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:18:48 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:18:48 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:18:48 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:18:48 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:18:48 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:18:48 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:18:48 user nova-compute[74638]:       <nova:owner>
Nov 08 20:18:48 user nova-compute[74638]:         <nova:user uuid="fc302495f45a4ae1bd2524aa60ecbc85">tempest-ServerActionsTestOtherA-1281886616-project-member</nova:user>
Nov 08 20:18:48 user nova-compute[74638]:         <nova:project uuid="4d0b2492206349f197739ee10c95a28f">tempest-ServerActionsTestOtherA-1281886616</nova:project>
Nov 08 20:18:48 user nova-compute[74638]:       </nova:owner>
Nov 08 20:18:48 user nova-compute[74638]:       <nova:ports>
Nov 08 20:18:48 user nova-compute[74638]:         <nova:port uuid="f0b1c9dd-a527-44b2-b88d-cf428bf72ba7">
Nov 08 20:18:48 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 20:18:48 user nova-compute[74638]:         </nova:port>
Nov 08 20:18:48 user nova-compute[74638]:       </nova:ports>
Nov 08 20:18:48 user nova-compute[74638]:     </nova:instance>
Nov 08 20:18:48 user nova-compute[74638]:   </metadata>
Nov 08 20:18:48 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:18:48 user nova-compute[74638]:     <system>
Nov 08 20:18:48 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:18:48 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:18:48 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:18:48 user nova-compute[74638]:       <entry name="serial">491aafd0-a4dd-4cb2-9584-e88c39367878</entry>
Nov 08 20:18:48 user nova-compute[74638]:       <entry name="uuid">491aafd0-a4dd-4cb2-9584-e88c39367878</entry>
Nov 08 20:18:48 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:18:48 user nova-compute[74638]:     </system>
Nov 08 20:18:48 user nova-compute[74638]:   </sysinfo>
Nov 08 20:18:48 user nova-compute[74638]:   <os>
Nov 08 20:18:48 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:18:48 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:18:48 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:18:48 user nova-compute[74638]:   </os>
Nov 08 20:18:48 user nova-compute[74638]:   <features>
Nov 08 20:18:48 user nova-compute[74638]:     <acpi/>
Nov 08 20:18:48 user nova-compute[74638]:     <apic/>
Nov 08 20:18:48 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:18:48 user nova-compute[74638]:   </features>
Nov 08 20:18:48 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:18:48 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:18:48 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:18:48 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:18:48 user nova-compute[74638]:   </clock>
Nov 08 20:18:48 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:18:48 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:18:48 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:18:48 user nova-compute[74638]:   </cpu>
Nov 08 20:18:48 user nova-compute[74638]:   <devices>
Nov 08 20:18:48 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:18:48 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:18:48 user nova-compute[74638]:       <source dev="/dev/sdb"/>
Nov 08 20:18:48 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:18:48 user nova-compute[74638]:       <serial>30e7f9f1-0309-4a06-8485-93af26b5674b</serial>
Nov 08 20:18:48 user nova-compute[74638]:     </disk>
Nov 08 20:18:48 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:18:48 user nova-compute[74638]:       <mac address="fa:16:3e:84:fe:6f"/>
Nov 08 20:18:48 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:18:48 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:18:48 user nova-compute[74638]:       <target dev="tapf0b1c9dd-a5"/>
Nov 08 20:18:48 user nova-compute[74638]:     </interface>
Nov 08 20:18:48 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:18:48 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/491aafd0-a4dd-4cb2-9584-e88c39367878/console.log" append="off"/>
Nov 08 20:18:48 user nova-compute[74638]:     </serial>
Nov 08 20:18:48 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:18:48 user nova-compute[74638]:     <video>
Nov 08 20:18:48 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:18:48 user nova-compute[74638]:     </video>
Nov 08 20:18:48 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:18:48 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:18:48 user nova-compute[74638]:     </rng>
Nov 08 20:18:48 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:18:48 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:18:48 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:18:48 user nova-compute[74638]:     </memballoon>
Nov 08 20:18:48 user nova-compute[74638]:   </devices>
Nov 08 20:18:48 user nova-compute[74638]: </domain>
Nov 08 20:18:48 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-912749548',display_name='tempest-ServerActionsTestOtherA-server-912749548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-912749548',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-qrmph4tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=491aafd0-a4dd-4cb2-9584-e88c39367878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG os_vif [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f5720c4-0d2a-56fa-bfd0-0ad61777cd77', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0b1c9dd-a5, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0b1c9dd-a5, col_values=(('qos', UUID('ad62b419-b041-4e51-9008-40d2c4025f38')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0b1c9dd-a5, col_values=(('external_ids', {'iface-id': 'f0b1c9dd-a527-44b2-b88d-cf428bf72ba7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:fe:6f', 'vm-uuid': '491aafd0-a4dd-4cb2-9584-e88c39367878'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:48 user nova-compute[74638]: INFO os_vif [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5')
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No VIF found with MAC fa:16:3e:84:fe:6f, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:18:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-e0c4a53c-1998-4526-adeb-c6bac88b9480 req-25344f03-c349-4eee-800b-8f98dc4e9def service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e0c4a53c-1998-4526-adeb-c6bac88b9480 req-25344f03-c349-4eee-800b-8f98dc4e9def service nova] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e0c4a53c-1998-4526-adeb-c6bac88b9480 req-25344f03-c349-4eee-800b-8f98dc4e9def service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e0c4a53c-1998-4526-adeb-c6bac88b9480 req-25344f03-c349-4eee-800b-8f98dc4e9def service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-e0c4a53c-1998-4526-adeb-c6bac88b9480 req-25344f03-c349-4eee-800b-8f98dc4e9def service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] No waiting events found dispatching network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:18:50 user nova-compute[74638]: WARNING nova.compute.manager [req-e0c4a53c-1998-4526-adeb-c6bac88b9480 req-25344f03-c349-4eee-800b-8f98dc4e9def service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received unexpected event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 for instance with vm_state building and task_state spawning.
Nov 08 20:18:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:18:51 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance spawned successfully.
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:18:52 user nova-compute[74638]: INFO nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 08 20:18:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:18:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-797dd95d-7dd6-4e81-8142-eda5c5f02f60 req-f5bab646-9cbc-4622-b158-3324dcbd1a59 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:18:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-797dd95d-7dd6-4e81-8142-eda5c5f02f60 req-f5bab646-9cbc-4622-b158-3324dcbd1a59 service nova] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:18:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-797dd95d-7dd6-4e81-8142-eda5c5f02f60 req-f5bab646-9cbc-4622-b158-3324dcbd1a59 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:18:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-797dd95d-7dd6-4e81-8142-eda5c5f02f60 req-f5bab646-9cbc-4622-b158-3324dcbd1a59 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-797dd95d-7dd6-4e81-8142-eda5c5f02f60 req-f5bab646-9cbc-4622-b158-3324dcbd1a59 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] No waiting events found dispatching network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:18:52 user nova-compute[74638]: WARNING nova.compute.manager [req-797dd95d-7dd6-4e81-8142-eda5c5f02f60 req-f5bab646-9cbc-4622-b158-3324dcbd1a59 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received unexpected event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 for instance with vm_state building and task_state spawning.
Nov 08 20:18:52 user nova-compute[74638]: INFO nova.compute.manager [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Took 34.25 seconds to build instance.
Nov 08 20:18:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05ac4c83-f1b6-436c-8c8e-d780a344aa68 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.377s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:18:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:56 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:18:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:18:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:18:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:18:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:18:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:18:59 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:18:59 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:00 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:19:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:19:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:19:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:19:01 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:19:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:19:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:19:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:04 user nova-compute[74638]: INFO nova.compute.manager [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Terminating instance
Nov 08 20:19:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-c31f16b7-23c8-4bb7-a18d-b1853c216b7d req-f905a8f7-5eb3-4046-9aa7-ca52c8468d5a service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received event network-vif-unplugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c31f16b7-23c8-4bb7-a18d-b1853c216b7d req-f905a8f7-5eb3-4046-9aa7-ca52c8468d5a service nova] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c31f16b7-23c8-4bb7-a18d-b1853c216b7d req-f905a8f7-5eb3-4046-9aa7-ca52c8468d5a service nova] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c31f16b7-23c8-4bb7-a18d-b1853c216b7d req-f905a8f7-5eb3-4046-9aa7-ca52c8468d5a service nova] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-c31f16b7-23c8-4bb7-a18d-b1853c216b7d req-f905a8f7-5eb3-4046-9aa7-ca52c8468d5a service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] No waiting events found dispatching network-vif-unplugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-c31f16b7-23c8-4bb7-a18d-b1853c216b7d req-f905a8f7-5eb3-4046-9aa7-ca52c8468d5a service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received event network-vif-unplugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Instance destroyed successfully.
Nov 08 20:19:05 user nova-compute[74638]: DEBUG nova.objects.instance [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lazy-loading 'resources' on Instance uuid 105b86cf-4f0f-4003-8407-42b945553b18 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1693000362',display_name='tempest-VolumesAdminNegativeTest-server-1693000362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1693000362',id=16,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoPo8hewdQGhZ/Hw6E5nFLoXDlY61KWiaxrCFx1+8OiX383Tgb/2ol/oBwETsQEBlJOykWj+GhgIYmPaNASszPP8LYKsU+tMHNlJgkWna/wgOjWhvduTSyiscFRch21sA==',key_name='tempest-keypair-644661497',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335d8305b8bf4f3c8083aabe8768c906',ramdisk_id='',reservation_id='r-po0cqcf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1731747303',owner_user_name='tempest-VolumesAdminNegativeTest-1731747303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa581d9fbb664526bfabb540888b2779',uuid=105b86cf-4f0f-4003-8407-42b945553b18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converting VIF {"id": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "address": "fa:16:3e:eb:23:b7", "network": {"id": "91d3264a-ee57-4e95-bb9c-bff9fbba85d7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1327601085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "335d8305b8bf4f3c8083aabe8768c906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac29bfff-79", "ovs_interfaceid": "ac29bfff-79d2-42a9-99c4-8d7dce3705fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac29bfff-79d2-42a9-99c4-8d7dce3705fc,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac29bfff-79') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG os_vif [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac29bfff-79d2-42a9-99c4-8d7dce3705fc,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac29bfff-79') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac29bfff-79, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a64a240-546e-487d-932b-b87fbb877af6) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:19:05 user nova-compute[74638]: INFO os_vif [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:23:b7,bridge_name='br-int',has_traffic_filtering=True,id=ac29bfff-79d2-42a9-99c4-8d7dce3705fc,network=Network(91d3264a-ee57-4e95-bb9c-bff9fbba85d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac29bfff-79')
Nov 08 20:19:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Deleting instance files /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18_del
Nov 08 20:19:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Deletion of /opt/stack/data/nova/instances/105b86cf-4f0f-4003-8407-42b945553b18_del complete
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:05 user nova-compute[74638]: INFO nova.compute.manager [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:19:06 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Took 1.01 seconds to deallocate network for instance.
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-95f9a8d1-b8a3-4136-8d1b-20ffb9e956aa req-0dc8ec14-c82f-4d0b-9149-b397279eb1e3 service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received event network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-95f9a8d1-b8a3-4136-8d1b-20ffb9e956aa req-0dc8ec14-c82f-4d0b-9149-b397279eb1e3 service nova] Acquiring lock "105b86cf-4f0f-4003-8407-42b945553b18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-95f9a8d1-b8a3-4136-8d1b-20ffb9e956aa req-0dc8ec14-c82f-4d0b-9149-b397279eb1e3 service nova] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-95f9a8d1-b8a3-4136-8d1b-20ffb9e956aa req-0dc8ec14-c82f-4d0b-9149-b397279eb1e3 service nova] Lock "105b86cf-4f0f-4003-8407-42b945553b18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-95f9a8d1-b8a3-4136-8d1b-20ffb9e956aa req-0dc8ec14-c82f-4d0b-9149-b397279eb1e3 service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] No waiting events found dispatching network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:06 user nova-compute[74638]: WARNING nova.compute.manager [req-95f9a8d1-b8a3-4136-8d1b-20ffb9e956aa req-0dc8ec14-c82f-4d0b-9149-b397279eb1e3 service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received unexpected event network-vif-plugged-ac29bfff-79d2-42a9-99c4-8d7dce3705fc for instance with vm_state deleted and task_state None.
Nov 08 20:19:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-95f9a8d1-b8a3-4136-8d1b-20ffb9e956aa req-0dc8ec14-c82f-4d0b-9149-b397279eb1e3 service nova] [instance: 105b86cf-4f0f-4003-8407-42b945553b18] Received event network-vif-deleted-ac29bfff-79d2-42a9-99c4-8d7dce3705fc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:06 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Deleted allocations for instance 105b86cf-4f0f-4003-8407-42b945553b18
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-06dc4628-7a03-45c1-aff5-80a2208c5e14 tempest-VolumesAdminNegativeTest-1731747303 tempest-VolumesAdminNegativeTest-1731747303-project-member] Lock "105b86cf-4f0f-4003-8407-42b945553b18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:07 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:19:07 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7638MB free_disk=25.390178680419922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 1953f44c-b839-4515-a0b4-1212bfa93092 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 491aafd0-a4dd-4cb2-9584-e88c39367878 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5ec97bac-185e-4959-b763-6514faef8e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 854bd78e-f3a1-4711-b880-56b0787eddf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:19:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:19:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:14 user nova-compute[74638]: INFO nova.compute.manager [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Terminating instance
Nov 08 20:19:14 user nova-compute[74638]: DEBUG nova.compute.manager [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-92122334-1fba-4b83-96e4-97028754b842 req-e458f7cd-42db-46f4-acd8-7f563c62837b service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-92122334-1fba-4b83-96e4-97028754b842 req-e458f7cd-42db-46f4-acd8-7f563c62837b service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-92122334-1fba-4b83-96e4-97028754b842 req-e458f7cd-42db-46f4-acd8-7f563c62837b service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-92122334-1fba-4b83-96e4-97028754b842 req-e458f7cd-42db-46f4-acd8-7f563c62837b service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-92122334-1fba-4b83-96e4-97028754b842 req-e458f7cd-42db-46f4-acd8-7f563c62837b service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-92122334-1fba-4b83-96e4-97028754b842 req-e458f7cd-42db-46f4-acd8-7f563c62837b service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-unplugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Instance destroyed successfully.
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.objects.instance [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lazy-loading 'resources' on Instance uuid 1953f44c-b839-4515-a0b4-1212bfa93092 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1737635490',display_name='tempest-ServerStableDeviceRescueTest-server-1737635490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1737635490',id=14,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv4BzGaDlMkGHGGrY4jSpEJ98U9jM3DTJwijs+luNH2DEebNfGrXkT4dqtpf/34BQk/mDcg+JeXTkYG/MiMXBYflJK97osFRYFp77MZm/WNRrQ9XpFvvMRDzoYfdjmvHA==',key_name='tempest-keypair-1947903140',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d043fa01edf445d7800d8769c42679b0',ramdisk_id='',reservation_id='r-i7fdsk39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1632952037',owner_user_name='tempest-ServerStableDeviceRescueTest-1632952037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b8fcd95c5640fe844391a748962632',uuid=1953f44c-b839-4515-a0b4-1212bfa93092,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Converting VIF {"id": "d614c985-f857-4c70-8c85-978502f3d371", "address": "fa:16:3e:f3:99:b0", "network": {"id": "dcda2602-3545-4300-b633-881db1a6c3d9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1266550081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d043fa01edf445d7800d8769c42679b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd614c985-f8", "ovs_interfaceid": "d614c985-f857-4c70-8c85-978502f3d371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=d614c985-f857-4c70-8c85-978502f3d371,network=Network(dcda2602-3545-4300-b633-881db1a6c3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd614c985-f8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG os_vif [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=d614c985-f857-4c70-8c85-978502f3d371,network=Network(dcda2602-3545-4300-b633-881db1a6c3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd614c985-f8') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd614c985-f8, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8f79f60-06b4-4a43-bc5e-2ecb1a32fd14) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:19:15 user nova-compute[74638]: INFO os_vif [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:99:b0,bridge_name='br-int',has_traffic_filtering=True,id=d614c985-f857-4c70-8c85-978502f3d371,network=Network(dcda2602-3545-4300-b633-881db1a6c3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd614c985-f8')
Nov 08 20:19:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Deleting instance files /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092_del
Nov 08 20:19:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Deletion of /opt/stack/data/nova/instances/1953f44c-b839-4515-a0b4-1212bfa93092_del complete
Nov 08 20:19:15 user nova-compute[74638]: INFO nova.compute.manager [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 20:19:15 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:19:15 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:19:16 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:19:16 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Took 1.21 seconds to deallocate network for instance.
Nov 08 20:19:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-d0a424ae-8cb5-4f4e-8d75-67d0f010764f req-023da774-9736-43ab-ae3a-9930d7807789 service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-deleted-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-555de4e8-9a8b-4511-9be7-46f0be868e25 req-306f6e20-ec1d-450c-baf4-7c6be266ab8f service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-555de4e8-9a8b-4511-9be7-46f0be868e25 req-306f6e20-ec1d-450c-baf4-7c6be266ab8f service nova] Acquiring lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-555de4e8-9a8b-4511-9be7-46f0be868e25 req-306f6e20-ec1d-450c-baf4-7c6be266ab8f service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-555de4e8-9a8b-4511-9be7-46f0be868e25 req-306f6e20-ec1d-450c-baf4-7c6be266ab8f service nova] Lock "1953f44c-b839-4515-a0b4-1212bfa93092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-555de4e8-9a8b-4511-9be7-46f0be868e25 req-306f6e20-ec1d-450c-baf4-7c6be266ab8f service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] No waiting events found dispatching network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:17 user nova-compute[74638]: WARNING nova.compute.manager [req-555de4e8-9a8b-4511-9be7-46f0be868e25 req-306f6e20-ec1d-450c-baf4-7c6be266ab8f service nova] [instance: 1953f44c-b839-4515-a0b4-1212bfa93092] Received unexpected event network-vif-plugged-d614c985-f857-4c70-8c85-978502f3d371 for instance with vm_state deleted and task_state None.
Nov 08 20:19:17 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:19:17 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:19:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:17 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Deleted allocations for instance 1953f44c-b839-4515-a0b4-1212bfa93092
Nov 08 20:19:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-79a90995-0d89-461e-97f6-188006307c12 tempest-ServerStableDeviceRescueTest-1632952037 tempest-ServerStableDeviceRescueTest-1632952037-project-member] Lock "1953f44c-b839-4515-a0b4-1212bfa93092" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.615s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:38 user nova-compute[74638]: INFO nova.compute.manager [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Rescuing
Nov 08 20:19:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:19:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquired lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:19:38 user nova-compute[74638]: DEBUG nova.network.neutron [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:19:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updating instance_info_cache with network_info: [{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Releasing lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-9ce72824-ba16-4555-9c16-3e183a3b121f req-3aa2ece4-4ae8-44a9-9156-757c418e84f6 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9ce72824-ba16-4555-9c16-3e183a3b121f req-3aa2ece4-4ae8-44a9-9156-757c418e84f6 service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9ce72824-ba16-4555-9c16-3e183a3b121f req-3aa2ece4-4ae8-44a9-9156-757c418e84f6 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9ce72824-ba16-4555-9c16-3e183a3b121f req-3aa2ece4-4ae8-44a9-9156-757c418e84f6 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-9ce72824-ba16-4555-9c16-3e183a3b121f req-3aa2ece4-4ae8-44a9-9156-757c418e84f6 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:39 user nova-compute[74638]: WARNING nova.compute.manager [req-9ce72824-ba16-4555-9c16-3e183a3b121f req-3aa2ece4-4ae8-44a9-9156-757c418e84f6 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state active and task_state rescuing.
Nov 08 20:19:39 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance destroyed successfully.
Nov 08 20:19:39 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Attempting rescue
Nov 08 20:19:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74638) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 20:19:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance directory exists: not creating {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 20:19:39 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Creating image(s)
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'trusted_certs' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue" returned: 0 in 0.054s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'migration_context' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.base [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<862f8350-1466-4fec-b58b-2d7bd2ee8579> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Start _get_guest_xml network_info=[{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:33:8e:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'resources' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.base [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<862f8350-1466-4fec-b58b-2d7bd2ee8579> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'numa_topology' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.base [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<862f8350-1466-4fec-b58b-2d7bd2ee8579> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:19:40 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:19:40 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'vcpu_model' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.base [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<862f8350-1466-4fec-b58b-2d7bd2ee8579> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055513977',display_name='tempest-ServerRescueNegativeTestJSON-server-2055513977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055513977',id=18,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:14:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-0mocgist',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:14:50Z,user_data=None,user_id='444c578cebff4167825165a737b5bb85',uuid=862f8350-1466-4fec-b58b-2d7bd2ee8579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:33:8e:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:33:8e:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:8e:9d,bridge_name='br-int',has_traffic_filtering=True,id=70d09fe3-1859-4697-bfcd-315471151873,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d09fe3-18') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'pci_devices' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.objects.base [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<862f8350-1466-4fec-b58b-2d7bd2ee8579> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:19:40 user nova-compute[74638]:   <uuid>862f8350-1466-4fec-b58b-2d7bd2ee8579</uuid>
Nov 08 20:19:40 user nova-compute[74638]:   <name>instance-00000012</name>
Nov 08 20:19:40 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:19:40 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:19:40 user nova-compute[74638]:   <metadata>
Nov 08 20:19:40 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:19:40 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:19:40 user nova-compute[74638]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2055513977</nova:name>
Nov 08 20:19:40 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:19:40</nova:creationTime>
Nov 08 20:19:40 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:19:40 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:19:40 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:19:40 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:19:40 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:19:40 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:19:40 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:19:40 user nova-compute[74638]:       <nova:owner>
Nov 08 20:19:40 user nova-compute[74638]:         <nova:user uuid="444c578cebff4167825165a737b5bb85">tempest-ServerRescueNegativeTestJSON-1603324862-project-member</nova:user>
Nov 08 20:19:40 user nova-compute[74638]:         <nova:project uuid="e5f133d71d494371b87181e746074d70">tempest-ServerRescueNegativeTestJSON-1603324862</nova:project>
Nov 08 20:19:40 user nova-compute[74638]:       </nova:owner>
Nov 08 20:19:40 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:19:40 user nova-compute[74638]:       <nova:ports>
Nov 08 20:19:40 user nova-compute[74638]:         <nova:port uuid="70d09fe3-1859-4697-bfcd-315471151873">
Nov 08 20:19:40 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 20:19:40 user nova-compute[74638]:         </nova:port>
Nov 08 20:19:40 user nova-compute[74638]:       </nova:ports>
Nov 08 20:19:40 user nova-compute[74638]:     </nova:instance>
Nov 08 20:19:40 user nova-compute[74638]:   </metadata>
Nov 08 20:19:40 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:19:40 user nova-compute[74638]:     <system>
Nov 08 20:19:40 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:19:40 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:19:40 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:19:40 user nova-compute[74638]:       <entry name="serial">862f8350-1466-4fec-b58b-2d7bd2ee8579</entry>
Nov 08 20:19:40 user nova-compute[74638]:       <entry name="uuid">862f8350-1466-4fec-b58b-2d7bd2ee8579</entry>
Nov 08 20:19:40 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:19:40 user nova-compute[74638]:     </system>
Nov 08 20:19:40 user nova-compute[74638]:   </sysinfo>
Nov 08 20:19:40 user nova-compute[74638]:   <os>
Nov 08 20:19:40 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:19:40 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:19:40 user nova-compute[74638]:   </os>
Nov 08 20:19:40 user nova-compute[74638]:   <features>
Nov 08 20:19:40 user nova-compute[74638]:     <acpi/>
Nov 08 20:19:40 user nova-compute[74638]:     <apic/>
Nov 08 20:19:40 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:19:40 user nova-compute[74638]:   </features>
Nov 08 20:19:40 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:19:40 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:19:40 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:19:40 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:19:40 user nova-compute[74638]:   </clock>
Nov 08 20:19:40 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:19:40 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:19:40 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:19:40 user nova-compute[74638]:   </cpu>
Nov 08 20:19:40 user nova-compute[74638]:   <devices>
Nov 08 20:19:40 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:19:40 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:19:40 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue"/>
Nov 08 20:19:40 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:19:40 user nova-compute[74638]:     </disk>
Nov 08 20:19:40 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:19:40 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:19:40 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk"/>
Nov 08 20:19:40 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:19:40 user nova-compute[74638]:     </disk>
Nov 08 20:19:40 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:19:40 user nova-compute[74638]:       <mac address="fa:16:3e:33:8e:9d"/>
Nov 08 20:19:40 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:19:40 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:19:40 user nova-compute[74638]:       <target dev="tap70d09fe3-18"/>
Nov 08 20:19:40 user nova-compute[74638]:     </interface>
Nov 08 20:19:40 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:19:40 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/console.log" append="off"/>
Nov 08 20:19:40 user nova-compute[74638]:     </serial>
Nov 08 20:19:40 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:19:40 user nova-compute[74638]:     <video>
Nov 08 20:19:40 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:19:40 user nova-compute[74638]:     </video>
Nov 08 20:19:40 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:19:40 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:19:40 user nova-compute[74638]:     </rng>
Nov 08 20:19:40 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:19:40 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:19:40 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:19:40 user nova-compute[74638]:     </memballoon>
Nov 08 20:19:40 user nova-compute[74638]:   </devices>
Nov 08 20:19:40 user nova-compute[74638]: </domain>
Nov 08 20:19:40 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:19:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance destroyed successfully.
Nov 08 20:19:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No VIF found with MAC fa:16:3e:33:8e:9d, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "0e529715-d390-4929-998f-5835de148256" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:19:40 user nova-compute[74638]: INFO nova.compute.claims [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Claim successful on node user
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:19:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.policy [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b93d3cfa1354826ab6ff1efbe49f46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1466c6af77ed4c838f917c826e4c3594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:19:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Creating image(s)
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "/opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "/opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.170s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk 1073741824" returned: 0 in 0.046s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-fd4c47a5-f1fe-44ad-ac7b-8983af1565d9 req-a7520198-09e5-4eb5-a55b-79c5c46b145a service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd4c47a5-f1fe-44ad-ac7b-8983af1565d9 req-a7520198-09e5-4eb5-a55b-79c5c46b145a service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd4c47a5-f1fe-44ad-ac7b-8983af1565d9 req-a7520198-09e5-4eb5-a55b-79c5c46b145a service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd4c47a5-f1fe-44ad-ac7b-8983af1565d9 req-a7520198-09e5-4eb5-a55b-79c5c46b145a service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-fd4c47a5-f1fe-44ad-ac7b-8983af1565d9 req-a7520198-09e5-4eb5-a55b-79c5c46b145a service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:41 user nova-compute[74638]: WARNING nova.compute.manager [req-fd4c47a5-f1fe-44ad-ac7b-8983af1565d9 req-a7520198-09e5-4eb5-a55b-79c5c46b145a service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state active and task_state rescuing.
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Successfully created port: a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Cannot resize image /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Ensure instance console log exists: /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Successfully updated port: a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquired lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-7e5a6042-35a5-4393-b1c3-e4ad762a3038 req-acd4acfd-5576-46a5-8fa9-8f673887396e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Received event network-changed-a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-7e5a6042-35a5-4393-b1c3-e4ad762a3038 req-acd4acfd-5576-46a5-8fa9-8f673887396e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Refreshing instance network info cache due to event network-changed-a69986fb-6b77-46b9-a993-b37e8a9dbb67. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7e5a6042-35a5-4393-b1c3-e4ad762a3038 req-acd4acfd-5576-46a5-8fa9-8f673887396e service nova] Acquiring lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:19:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Updating instance_info_cache with network_info: [{"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Releasing lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Instance network_info: |[{"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7e5a6042-35a5-4393-b1c3-e4ad762a3038 req-acd4acfd-5576-46a5-8fa9-8f673887396e service nova] Acquired lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-7e5a6042-35a5-4393-b1c3-e4ad762a3038 req-acd4acfd-5576-46a5-8fa9-8f673887396e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Refreshing network info cache for port a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Start _get_guest_xml network_info=[{"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:19:43 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:19:43 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-701485231',display_name='tempest-TestStampPattern-server-701485231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-701485231',id=24,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxvPfR3m68mdARrbfav97jTy/o6OtKTjWJzrXNp0gr/QQk683HsyF983f34HQBJajTLCCF+GqbGWDF/11evWSydJuVmWuB9oczkR7bNKj4AYdUUQAWpsJK386HZ1lIOpA==',key_name='tempest-TestStampPattern-1081975694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1466c6af77ed4c838f917c826e4c3594',ramdisk_id='',reservation_id='r-o4wgvurw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-248486380',owner_user_name='tempest-TestStampPattern-248486380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:19:41Z,user_data=None,user_id='5b93d3cfa1354826ab6ff1efbe49f46d',uuid=0e529715-d390-4929-998f-5835de148256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converting VIF {"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:76:62,bridge_name='br-int',has_traffic_filtering=True,id=a69986fb-6b77-46b9-a993-b37e8a9dbb67,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69986fb-6b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.objects.instance [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e529715-d390-4929-998f-5835de148256 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:19:43 user nova-compute[74638]:   <uuid>0e529715-d390-4929-998f-5835de148256</uuid>
Nov 08 20:19:43 user nova-compute[74638]:   <name>instance-00000018</name>
Nov 08 20:19:43 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:19:43 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:19:43 user nova-compute[74638]:   <metadata>
Nov 08 20:19:43 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:19:43 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:19:43 user nova-compute[74638]:       <nova:name>tempest-TestStampPattern-server-701485231</nova:name>
Nov 08 20:19:43 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:19:43</nova:creationTime>
Nov 08 20:19:43 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:19:43 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:19:43 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:19:43 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:19:43 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:19:43 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:19:43 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:19:43 user nova-compute[74638]:       <nova:owner>
Nov 08 20:19:43 user nova-compute[74638]:         <nova:user uuid="5b93d3cfa1354826ab6ff1efbe49f46d">tempest-TestStampPattern-248486380-project-member</nova:user>
Nov 08 20:19:43 user nova-compute[74638]:         <nova:project uuid="1466c6af77ed4c838f917c826e4c3594">tempest-TestStampPattern-248486380</nova:project>
Nov 08 20:19:43 user nova-compute[74638]:       </nova:owner>
Nov 08 20:19:43 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:19:43 user nova-compute[74638]:       <nova:ports>
Nov 08 20:19:43 user nova-compute[74638]:         <nova:port uuid="a69986fb-6b77-46b9-a993-b37e8a9dbb67">
Nov 08 20:19:43 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 20:19:43 user nova-compute[74638]:         </nova:port>
Nov 08 20:19:43 user nova-compute[74638]:       </nova:ports>
Nov 08 20:19:43 user nova-compute[74638]:     </nova:instance>
Nov 08 20:19:43 user nova-compute[74638]:   </metadata>
Nov 08 20:19:43 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:19:43 user nova-compute[74638]:     <system>
Nov 08 20:19:43 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:19:43 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:19:43 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:19:43 user nova-compute[74638]:       <entry name="serial">0e529715-d390-4929-998f-5835de148256</entry>
Nov 08 20:19:43 user nova-compute[74638]:       <entry name="uuid">0e529715-d390-4929-998f-5835de148256</entry>
Nov 08 20:19:43 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:19:43 user nova-compute[74638]:     </system>
Nov 08 20:19:43 user nova-compute[74638]:   </sysinfo>
Nov 08 20:19:43 user nova-compute[74638]:   <os>
Nov 08 20:19:43 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:19:43 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:19:43 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:19:43 user nova-compute[74638]:   </os>
Nov 08 20:19:43 user nova-compute[74638]:   <features>
Nov 08 20:19:43 user nova-compute[74638]:     <acpi/>
Nov 08 20:19:43 user nova-compute[74638]:     <apic/>
Nov 08 20:19:43 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:19:43 user nova-compute[74638]:   </features>
Nov 08 20:19:43 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:19:43 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:19:43 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:19:43 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:19:43 user nova-compute[74638]:   </clock>
Nov 08 20:19:43 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:19:43 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:19:43 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:19:43 user nova-compute[74638]:   </cpu>
Nov 08 20:19:43 user nova-compute[74638]:   <devices>
Nov 08 20:19:43 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:19:43 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:19:43 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk"/>
Nov 08 20:19:43 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:19:43 user nova-compute[74638]:     </disk>
Nov 08 20:19:43 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:19:43 user nova-compute[74638]:       <mac address="fa:16:3e:85:76:62"/>
Nov 08 20:19:43 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:19:43 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:19:43 user nova-compute[74638]:       <target dev="tapa69986fb-6b"/>
Nov 08 20:19:43 user nova-compute[74638]:     </interface>
Nov 08 20:19:43 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:19:43 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/console.log" append="off"/>
Nov 08 20:19:43 user nova-compute[74638]:     </serial>
Nov 08 20:19:43 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:19:43 user nova-compute[74638]:     <video>
Nov 08 20:19:43 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:19:43 user nova-compute[74638]:     </video>
Nov 08 20:19:43 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:19:43 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:19:43 user nova-compute[74638]:     </rng>
Nov 08 20:19:43 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:19:43 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:19:43 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:19:43 user nova-compute[74638]:     </memballoon>
Nov 08 20:19:43 user nova-compute[74638]:   </devices>
Nov 08 20:19:43 user nova-compute[74638]: </domain>
Nov 08 20:19:43 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-701485231',display_name='tempest-TestStampPattern-server-701485231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-701485231',id=24,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxvPfR3m68mdARrbfav97jTy/o6OtKTjWJzrXNp0gr/QQk683HsyF983f34HQBJajTLCCF+GqbGWDF/11evWSydJuVmWuB9oczkR7bNKj4AYdUUQAWpsJK386HZ1lIOpA==',key_name='tempest-TestStampPattern-1081975694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1466c6af77ed4c838f917c826e4c3594',ramdisk_id='',reservation_id='r-o4wgvurw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-248486380',owner_user_name='tempest-TestStampPattern-248486380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:19:41Z,user_data=None,user_id='5b93d3cfa1354826ab6ff1efbe49f46d',uuid=0e529715-d390-4929-998f-5835de148256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converting VIF {"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:76:62,bridge_name='br-int',has_traffic_filtering=True,id=a69986fb-6b77-46b9-a993-b37e8a9dbb67,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69986fb-6b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG os_vif [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:76:62,bridge_name='br-int',has_traffic_filtering=True,id=a69986fb-6b77-46b9-a993-b37e8a9dbb67,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69986fb-6b') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c596571d-25b7-5b72-9f96-bcaa65fb6a75', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa69986fb-6b, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa69986fb-6b, col_values=(('qos', UUID('e6d0fff9-f631-4e2e-8859-2161cf34a467')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa69986fb-6b, col_values=(('external_ids', {'iface-id': 'a69986fb-6b77-46b9-a993-b37e8a9dbb67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:76:62', 'vm-uuid': '0e529715-d390-4929-998f-5835de148256'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:43 user nova-compute[74638]: INFO os_vif [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:76:62,bridge_name='br-int',has_traffic_filtering=True,id=a69986fb-6b77-46b9-a993-b37e8a9dbb67,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69986fb-6b')
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No VIF found with MAC fa:16:3e:85:76:62, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-7e5a6042-35a5-4393-b1c3-e4ad762a3038 req-acd4acfd-5576-46a5-8fa9-8f673887396e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Updated VIF entry in instance network info cache for port a69986fb-6b77-46b9-a993-b37e8a9dbb67. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-7e5a6042-35a5-4393-b1c3-e4ad762a3038 req-acd4acfd-5576-46a5-8fa9-8f673887396e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Updating instance_info_cache with network_info: [{"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7e5a6042-35a5-4393-b1c3-e4ad762a3038 req-acd4acfd-5576-46a5-8fa9-8f673887396e service nova] Releasing lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:19:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:44 user nova-compute[74638]: WARNING nova.compute.manager [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state active and task_state rescuing.
Nov 08 20:19:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:44 user nova-compute[74638]: WARNING nova.compute.manager [req-0bc6c29d-b197-4041-8d33-6703d7215596 req-4b37d3f5-648e-4d41-a7d6-eaedcf1c591b service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state active and task_state rescuing.
Nov 08 20:19:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2f113fa2-1274-434b-8762-a8b97fa517d5 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-eb00f136-6821-4e2d-a349-cb6cc847a90f req-cba4028a-8018-494d-b6c4-4ce40fdc8e24 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Received event network-vif-plugged-a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-eb00f136-6821-4e2d-a349-cb6cc847a90f req-cba4028a-8018-494d-b6c4-4ce40fdc8e24 service nova] Acquiring lock "0e529715-d390-4929-998f-5835de148256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-eb00f136-6821-4e2d-a349-cb6cc847a90f req-cba4028a-8018-494d-b6c4-4ce40fdc8e24 service nova] Lock "0e529715-d390-4929-998f-5835de148256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-eb00f136-6821-4e2d-a349-cb6cc847a90f req-cba4028a-8018-494d-b6c4-4ce40fdc8e24 service nova] Lock "0e529715-d390-4929-998f-5835de148256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-eb00f136-6821-4e2d-a349-cb6cc847a90f req-cba4028a-8018-494d-b6c4-4ce40fdc8e24 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] No waiting events found dispatching network-vif-plugged-a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:45 user nova-compute[74638]: WARNING nova.compute.manager [req-eb00f136-6821-4e2d-a349-cb6cc847a90f req-cba4028a-8018-494d-b6c4-4ce40fdc8e24 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Received unexpected event network-vif-plugged-a69986fb-6b77-46b9-a993-b37e8a9dbb67 for instance with vm_state building and task_state spawning.
Nov 08 20:19:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:19:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0e529715-d390-4929-998f-5835de148256] Instance spawned successfully.
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-c6bcec7c-d74b-4746-9204-fb1220310287 req-126799ff-e353-471e-af86-efdc1b6889ba service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Received event network-vif-plugged-a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c6bcec7c-d74b-4746-9204-fb1220310287 req-126799ff-e353-471e-af86-efdc1b6889ba service nova] Acquiring lock "0e529715-d390-4929-998f-5835de148256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c6bcec7c-d74b-4746-9204-fb1220310287 req-126799ff-e353-471e-af86-efdc1b6889ba service nova] Lock "0e529715-d390-4929-998f-5835de148256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c6bcec7c-d74b-4746-9204-fb1220310287 req-126799ff-e353-471e-af86-efdc1b6889ba service nova] Lock "0e529715-d390-4929-998f-5835de148256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-c6bcec7c-d74b-4746-9204-fb1220310287 req-126799ff-e353-471e-af86-efdc1b6889ba service nova] [instance: 0e529715-d390-4929-998f-5835de148256] No waiting events found dispatching network-vif-plugged-a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:19:47 user nova-compute[74638]: WARNING nova.compute.manager [req-c6bcec7c-d74b-4746-9204-fb1220310287 req-126799ff-e353-471e-af86-efdc1b6889ba service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Received unexpected event network-vif-plugged-a69986fb-6b77-46b9-a993-b37e8a9dbb67 for instance with vm_state building and task_state spawning.
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:19:47 user nova-compute[74638]: INFO nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 08 20:19:47 user nova-compute[74638]: DEBUG nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:19:47 user nova-compute[74638]: INFO nova.compute.manager [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Took 6.56 seconds to build instance.
Nov 08 20:19:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-794df8af-49fc-459a-8ec1-b150643051f4 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.715s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:19:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:54 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:19:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:19:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:20:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:00 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:20:01 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updating instance_info_cache with network_info: [{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:01 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:20:01 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:20:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:07 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:20:07 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7795MB free_disk=25.503311157226562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 491aafd0-a4dd-4cb2-9584-e88c39367878 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5ec97bac-185e-4959-b763-6514faef8e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 854bd78e-f3a1-4711-b880-56b0787eddf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:20:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-8e8950e5-07d8-4f91-af5e-f46617d22260 req-30a3cde0-975a-4c36-9b33-fd840201ba25 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-changed-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-8e8950e5-07d8-4f91-af5e-f46617d22260 req-30a3cde0-975a-4c36-9b33-fd840201ba25 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Refreshing instance network info cache due to event network-changed-fe0448bd-7de8-4903-85a8-e9e452f2fec2. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8e8950e5-07d8-4f91-af5e-f46617d22260 req-30a3cde0-975a-4c36-9b33-fd840201ba25 service nova] Acquiring lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8e8950e5-07d8-4f91-af5e-f46617d22260 req-30a3cde0-975a-4c36-9b33-fd840201ba25 service nova] Acquired lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:08 user nova-compute[74638]: DEBUG nova.network.neutron [req-8e8950e5-07d8-4f91-af5e-f46617d22260 req-30a3cde0-975a-4c36-9b33-fd840201ba25 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Refreshing network info cache for port fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:20:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-8e8950e5-07d8-4f91-af5e-f46617d22260 req-30a3cde0-975a-4c36-9b33-fd840201ba25 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updated VIF entry in instance network info cache for port fe0448bd-7de8-4903-85a8-e9e452f2fec2. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:20:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-8e8950e5-07d8-4f91-af5e-f46617d22260 req-30a3cde0-975a-4c36-9b33-fd840201ba25 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8e8950e5-07d8-4f91-af5e-f46617d22260 req-30a3cde0-975a-4c36-9b33-fd840201ba25 service nova] Releasing lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-13e61a7d-e2ea-4314-9a3f-fe01c7af77bc req-0c4c6353-1443-4e4e-b9d9-38e361f10846 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-changed-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-13e61a7d-e2ea-4314-9a3f-fe01c7af77bc req-0c4c6353-1443-4e4e-b9d9-38e361f10846 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Refreshing instance network info cache due to event network-changed-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-13e61a7d-e2ea-4314-9a3f-fe01c7af77bc req-0c4c6353-1443-4e4e-b9d9-38e361f10846 service nova] Acquiring lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-13e61a7d-e2ea-4314-9a3f-fe01c7af77bc req-0c4c6353-1443-4e4e-b9d9-38e361f10846 service nova] Acquired lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-13e61a7d-e2ea-4314-9a3f-fe01c7af77bc req-0c4c6353-1443-4e4e-b9d9-38e361f10846 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Refreshing network info cache for port f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Stashing vm_state: active {{(pid=74638) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:20:11 user nova-compute[74638]: INFO nova.compute.claims [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Claim successful on node user
Nov 08 20:20:11 user nova-compute[74638]: INFO nova.compute.resource_tracker [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating resource usage from migration 11cf525b-1dd9-479e-ad68-9e2972eb2503
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.504s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:11 user nova-compute[74638]: INFO nova.compute.manager [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Migrating
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:11 user nova-compute[74638]: INFO nova.compute.rpcapi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-13e61a7d-e2ea-4314-9a3f-fe01c7af77bc req-0c4c6353-1443-4e4e-b9d9-38e361f10846 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updated VIF entry in instance network info cache for port f0b1c9dd-a527-44b2-b88d-cf428bf72ba7. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.network.neutron [req-13e61a7d-e2ea-4314-9a3f-fe01c7af77bc req-0c4c6353-1443-4e4e-b9d9-38e361f10846 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating instance_info_cache with network_info: [{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-13e61a7d-e2ea-4314-9a3f-fe01c7af77bc req-0c4c6353-1443-4e4e-b9d9-38e361f10846 service nova] Releasing lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquired lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating instance_info_cache with network_info: [{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Releasing lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Starting migrate_disk_and_power_off {{(pid=74638) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG nova.compute.manager [req-2784735b-d298-4872-b415-24d84b034f75 req-695d20b6-9f79-4fca-89af-28eba2aaa9ca service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-unplugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2784735b-d298-4872-b415-24d84b034f75 req-695d20b6-9f79-4fca-89af-28eba2aaa9ca service nova] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2784735b-d298-4872-b415-24d84b034f75 req-695d20b6-9f79-4fca-89af-28eba2aaa9ca service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2784735b-d298-4872-b415-24d84b034f75 req-695d20b6-9f79-4fca-89af-28eba2aaa9ca service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:12 user nova-compute[74638]: DEBUG nova.compute.manager [req-2784735b-d298-4872-b415-24d84b034f75 req-695d20b6-9f79-4fca-89af-28eba2aaa9ca service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] No waiting events found dispatching network-vif-unplugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:20:12 user nova-compute[74638]: WARNING nova.compute.manager [req-2784735b-d298-4872-b415-24d84b034f75 req-695d20b6-9f79-4fca-89af-28eba2aaa9ca service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received unexpected event network-vif-unplugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 for instance with vm_state active and task_state resize_migrating.
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-64ac2a56-9a47-4524-836b-fc2d930928bb req-6f555332-6c1d-47ae-a22e-aba77610939e service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received event network-changed-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-64ac2a56-9a47-4524-836b-fc2d930928bb req-6f555332-6c1d-47ae-a22e-aba77610939e service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Refreshing instance network info cache due to event network-changed-20297004-c8b7-4d79-865d-dd041c9178d2. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64ac2a56-9a47-4524-836b-fc2d930928bb req-6f555332-6c1d-47ae-a22e-aba77610939e service nova] Acquiring lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64ac2a56-9a47-4524-836b-fc2d930928bb req-6f555332-6c1d-47ae-a22e-aba77610939e service nova] Acquired lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-64ac2a56-9a47-4524-836b-fc2d930928bb req-6f555332-6c1d-47ae-a22e-aba77610939e service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Refreshing network info cache for port 20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance destroyed successfully.
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-912749548',display_name='tempest-ServerActionsTestOtherA-server-912749548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-912749548',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-qrmph4tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=491aafd0-a4dd-4cb2-9584-e88c39367878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-704165763-network", "vif_mac": "fa:16:3e:84:fe:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-704165763-network", "vif_mac": "fa:16:3e:84:fe:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_vif [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0b1c9dd-a5, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad62b419-b041-4e51-9008-40d2c4025f38) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:20:13 user nova-compute[74638]: INFO os_vif [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5')
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJThDUgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:20:13 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e140366-3952-4ae8-b16c-a2c549086c4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:392f8ac4-9222-41b6-80b9-0214f43dd635\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:20:13 user nova-compute[74638]: No targets found.
Nov 08 20:20:13 user nova-compute[74638]: iSNS:
Nov 08 20:20:13 user nova-compute[74638]: No targets found.
Nov 08 20:20:13 user nova-compute[74638]: STATIC:
Nov 08 20:20:13 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:392f8ac4-9222-41b6-80b9-0214f43dd635
Nov 08 20:20:13 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:20:13 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:20:13 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b
Nov 08 20:20:13 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:20:13 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:20:13 user nova-compute[74638]: FIRMWARE:
Nov 08 20:20:13 user nova-compute[74638]: No targets found.
Nov 08 20:20:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:20:13 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:20:13 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cfc27c-d645-4c0f-9bbd-12f697891eb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:392f8ac4-9222-41b6-80b9-0214f43dd635\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3be5b2f-58c4-4fa3-ac19-eade72605bcf]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:392f8ac4-9222-41b6-80b9-0214f43dd635 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:20:13 user nova-compute[74638]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:392f8ac4-9222-41b6-80b9-0214f43dd635 (non-flash)
Nov 08 20:20:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:20:13 user nova-compute[74638]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:392f8ac4-9222-41b6-80b9-0214f43dd635 (non-flash)
Nov 08 20:20:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c356d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7e866a-af7a-418b-9ad5-6de88dd25eb0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c8d13-ba74-4b79-bbf0-d7c268c6b6e0]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b4e742-112b-4cb7-a66a-59cfa96987a7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a7367-e29c-4bd0-86da-719267f8ccf7]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cff103d0', '/dev/disk/by-id/scsi-1SCST_BIOcff103d0-86d3034b4e45daf5', '/dev/disk/by-id/scsi-23836643330333462') {{(pid=85977) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2213f9-ad79-4935-84ea-e95368638a47]: (4, None) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[240b1c32-adfd-4054-a6bf-bbd8b0198636]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[232b505f-df0f-4b2b-8d15-ebf347143f9c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260]
Nov 08 20:20:13 user nova-compute[74638]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260] successful.
Nov 08 20:20:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-64ac2a56-9a47-4524-836b-fc2d930928bb req-6f555332-6c1d-47ae-a22e-aba77610939e service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updated VIF entry in instance network info cache for port 20297004-c8b7-4d79-865d-dd041c9178d2. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-64ac2a56-9a47-4524-836b-fc2d930928bb req-6f555332-6c1d-47ae-a22e-aba77610939e service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updating instance_info_cache with network_info: [{"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfb40ed-ff82-4a6d-b9f5-dbd7e3176bea]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== disconnect_volume: return (401ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:20:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64ac2a56-9a47-4524-836b-fc2d930928bb req-6f555332-6c1d-47ae-a22e-aba77610939e service nova] Releasing lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-4b4a36d2-3690-4c9f-a553-881767004dda req-afd2244d-499e-4d39-8312-ff8bc58d963c service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4b4a36d2-3690-4c9f-a553-881767004dda req-afd2244d-499e-4d39-8312-ff8bc58d963c service nova] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4b4a36d2-3690-4c9f-a553-881767004dda req-afd2244d-499e-4d39-8312-ff8bc58d963c service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4b4a36d2-3690-4c9f-a553-881767004dda req-afd2244d-499e-4d39-8312-ff8bc58d963c service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-4b4a36d2-3690-4c9f-a553-881767004dda req-afd2244d-499e-4d39-8312-ff8bc58d963c service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] No waiting events found dispatching network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:20:15 user nova-compute[74638]: WARNING nova.compute.manager [req-4b4a36d2-3690-4c9f-a553-881767004dda req-afd2244d-499e-4d39-8312-ff8bc58d963c service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received unexpected event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 for instance with vm_state active and task_state resize_migrating.
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:20:15 user nova-compute[74638]: INFO nova.compute.claims [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Claim successful on node user
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:20:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.policy [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ab02946569c47ff9772753454afc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69c08c247c41cd842c3673cf9af390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:20:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Creating image(s)
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "/opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "/opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk 1073741824" returned: 0 in 0.052s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Successfully created port: 979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Cannot resize image /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Ensure instance console log exists: /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Successfully updated port: 979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquired lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-3b2e2b84-9759-488e-a922-61bfb4d477ca req-e046d1f2-5a2f-4885-93bc-43d97f1fcbb7 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received event network-changed-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-3b2e2b84-9759-488e-a922-61bfb4d477ca req-e046d1f2-5a2f-4885-93bc-43d97f1fcbb7 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Refreshing instance network info cache due to event network-changed-979e34e9-2f00-4e0f-8228-c4f39ac78755. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3b2e2b84-9759-488e-a922-61bfb4d477ca req-e046d1f2-5a2f-4885-93bc-43d97f1fcbb7 service nova] Acquiring lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updating instance_info_cache with network_info: [{"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Releasing lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Instance network_info: |[{"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3b2e2b84-9759-488e-a922-61bfb4d477ca req-e046d1f2-5a2f-4885-93bc-43d97f1fcbb7 service nova] Acquired lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.neutron [req-3b2e2b84-9759-488e-a922-61bfb4d477ca req-e046d1f2-5a2f-4885-93bc-43d97f1fcbb7 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Refreshing network info cache for port 979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Start _get_guest_xml network_info=[{"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:20:17 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:20:17 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2037527489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2037527489',id=25,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-wso06n86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:20:16Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=9c01852a-a4a9-48d9-a6f2-c74a31643837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:14:3f,bridge_name='br-int',has_traffic_filtering=True,id=979e34e9-2f00-4e0f-8228-c4f39ac78755,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap979e34e9-2f') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.objects.instance [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c01852a-a4a9-48d9-a6f2-c74a31643837 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:20:17 user nova-compute[74638]:   <uuid>9c01852a-a4a9-48d9-a6f2-c74a31643837</uuid>
Nov 08 20:20:17 user nova-compute[74638]:   <name>instance-00000019</name>
Nov 08 20:20:17 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:20:17 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:20:17 user nova-compute[74638]:   <metadata>
Nov 08 20:20:17 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:20:17 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:20:17 user nova-compute[74638]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2037527489</nova:name>
Nov 08 20:20:17 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:20:17</nova:creationTime>
Nov 08 20:20:17 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:20:17 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:20:17 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:20:17 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:20:17 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:20:17 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:20:17 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:20:17 user nova-compute[74638]:       <nova:owner>
Nov 08 20:20:17 user nova-compute[74638]:         <nova:user uuid="9ab02946569c47ff9772753454afc5b3">tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member</nova:user>
Nov 08 20:20:17 user nova-compute[74638]:         <nova:project uuid="9d69c08c247c41cd842c3673cf9af390">tempest-ServerBootFromVolumeStableRescueTest-1821986023</nova:project>
Nov 08 20:20:17 user nova-compute[74638]:       </nova:owner>
Nov 08 20:20:17 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:20:17 user nova-compute[74638]:       <nova:ports>
Nov 08 20:20:17 user nova-compute[74638]:         <nova:port uuid="979e34e9-2f00-4e0f-8228-c4f39ac78755">
Nov 08 20:20:17 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 20:20:17 user nova-compute[74638]:         </nova:port>
Nov 08 20:20:17 user nova-compute[74638]:       </nova:ports>
Nov 08 20:20:17 user nova-compute[74638]:     </nova:instance>
Nov 08 20:20:17 user nova-compute[74638]:   </metadata>
Nov 08 20:20:17 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:20:17 user nova-compute[74638]:     <system>
Nov 08 20:20:17 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:20:17 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:20:17 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:20:17 user nova-compute[74638]:       <entry name="serial">9c01852a-a4a9-48d9-a6f2-c74a31643837</entry>
Nov 08 20:20:17 user nova-compute[74638]:       <entry name="uuid">9c01852a-a4a9-48d9-a6f2-c74a31643837</entry>
Nov 08 20:20:17 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:20:17 user nova-compute[74638]:     </system>
Nov 08 20:20:17 user nova-compute[74638]:   </sysinfo>
Nov 08 20:20:17 user nova-compute[74638]:   <os>
Nov 08 20:20:17 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:20:17 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:20:17 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:20:17 user nova-compute[74638]:   </os>
Nov 08 20:20:17 user nova-compute[74638]:   <features>
Nov 08 20:20:17 user nova-compute[74638]:     <acpi/>
Nov 08 20:20:17 user nova-compute[74638]:     <apic/>
Nov 08 20:20:17 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:20:17 user nova-compute[74638]:   </features>
Nov 08 20:20:17 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:20:17 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:20:17 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:20:17 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:20:17 user nova-compute[74638]:   </clock>
Nov 08 20:20:17 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:20:17 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:20:17 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:20:17 user nova-compute[74638]:   </cpu>
Nov 08 20:20:17 user nova-compute[74638]:   <devices>
Nov 08 20:20:17 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:20:17 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:20:17 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk"/>
Nov 08 20:20:17 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:20:17 user nova-compute[74638]:     </disk>
Nov 08 20:20:17 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:20:17 user nova-compute[74638]:       <mac address="fa:16:3e:bc:14:3f"/>
Nov 08 20:20:17 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:20:17 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:20:17 user nova-compute[74638]:       <target dev="tap979e34e9-2f"/>
Nov 08 20:20:17 user nova-compute[74638]:     </interface>
Nov 08 20:20:17 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:20:17 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/console.log" append="off"/>
Nov 08 20:20:17 user nova-compute[74638]:     </serial>
Nov 08 20:20:17 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:20:17 user nova-compute[74638]:     <video>
Nov 08 20:20:17 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:20:17 user nova-compute[74638]:     </video>
Nov 08 20:20:17 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:20:17 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:20:17 user nova-compute[74638]:     </rng>
Nov 08 20:20:17 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:20:17 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:20:17 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:20:17 user nova-compute[74638]:     </memballoon>
Nov 08 20:20:17 user nova-compute[74638]:   </devices>
Nov 08 20:20:17 user nova-compute[74638]: </domain>
Nov 08 20:20:17 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2037527489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2037527489',id=25,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-wso06n86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:20:16Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=9c01852a-a4a9-48d9-a6f2-c74a31643837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:14:3f,bridge_name='br-int',has_traffic_filtering=True,id=979e34e9-2f00-4e0f-8228-c4f39ac78755,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap979e34e9-2f') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG os_vif [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:14:3f,bridge_name='br-int',has_traffic_filtering=True,id=979e34e9-2f00-4e0f-8228-c4f39ac78755,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap979e34e9-2f') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7691f74-9bba-5a54-b333-52ee5146ec1e', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap979e34e9-2f, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap979e34e9-2f, col_values=(('qos', UUID('c24224f3-170e-4ab2-b3a7-e2e685b91ce8')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap979e34e9-2f, col_values=(('external_ids', {'iface-id': '979e34e9-2f00-4e0f-8228-c4f39ac78755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:14:3f', 'vm-uuid': '9c01852a-a4a9-48d9-a6f2-c74a31643837'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:17 user nova-compute[74638]: INFO os_vif [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:14:3f,bridge_name='br-int',has_traffic_filtering=True,id=979e34e9-2f00-4e0f-8228-c4f39ac78755,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap979e34e9-2f')
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No VIF found with MAC fa:16:3e:bc:14:3f, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.neutron [req-3b2e2b84-9759-488e-a922-61bfb4d477ca req-e046d1f2-5a2f-4885-93bc-43d97f1fcbb7 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updated VIF entry in instance network info cache for port 979e34e9-2f00-4e0f-8228-c4f39ac78755. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG nova.network.neutron [req-3b2e2b84-9759-488e-a922-61bfb4d477ca req-e046d1f2-5a2f-4885-93bc-43d97f1fcbb7 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updating instance_info_cache with network_info: [{"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3b2e2b84-9759-488e-a922-61bfb4d477ca req-e046d1f2-5a2f-4885-93bc-43d97f1fcbb7 service nova] Releasing lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:18 user nova-compute[74638]: DEBUG nova.objects.instance [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:20:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:19 user nova-compute[74638]: INFO nova.compute.manager [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Attaching volume 28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 to /dev/vdb
Nov 08 20:20:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-46a78bf4-6607-450d-a986-1aa32ad0c00b req-cc30d97d-818d-4f19-a418-8cb1cd10c389 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received event network-changed-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-46a78bf4-6607-450d-a986-1aa32ad0c00b req-cc30d97d-818d-4f19-a418-8cb1cd10c389 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Refreshing instance network info cache due to event network-changed-84c5fdc8-faae-454a-9a74-a9ff4bd3136c. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46a78bf4-6607-450d-a986-1aa32ad0c00b req-cc30d97d-818d-4f19-a418-8cb1cd10c389 service nova] Acquiring lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46a78bf4-6607-450d-a986-1aa32ad0c00b req-cc30d97d-818d-4f19-a418-8cb1cd10c389 service nova] Acquired lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG nova.network.neutron [req-46a78bf4-6607-450d-a986-1aa32ad0c00b req-cc30d97d-818d-4f19-a418-8cb1cd10c389 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Refreshing network info cache for port 84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG os_brick.utils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d3a3f-bf9b-4a9d-bca4-ec5e27c1ff04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[672dc7da-8a20-4152-8905-38096ad65dcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3438fd79-a448-4770-899d-36a866b3e200]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d2ebd7-0a7d-444b-95d6-d72417caa1f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:20:19 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f91bbbe-f4c0-4325-8801-5467eea8192b]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG os_brick.utils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updating existing volume attachment record: 6d27fb79-1543-481c-a1aa-52061d9d085f {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-216458fa-9b3b-47b2-97ea-0e3426c98a45 req-0a3e3e54-79b8-4978-97c1-e951aaae7c97 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received event network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-216458fa-9b3b-47b2-97ea-0e3426c98a45 req-0a3e3e54-79b8-4978-97c1-e951aaae7c97 service nova] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-216458fa-9b3b-47b2-97ea-0e3426c98a45 req-0a3e3e54-79b8-4978-97c1-e951aaae7c97 service nova] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-216458fa-9b3b-47b2-97ea-0e3426c98a45 req-0a3e3e54-79b8-4978-97c1-e951aaae7c97 service nova] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG nova.compute.manager [req-216458fa-9b3b-47b2-97ea-0e3426c98a45 req-0a3e3e54-79b8-4978-97c1-e951aaae7c97 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] No waiting events found dispatching network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:20:19 user nova-compute[74638]: WARNING nova.compute.manager [req-216458fa-9b3b-47b2-97ea-0e3426c98a45 req-0a3e3e54-79b8-4978-97c1-e951aaae7c97 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received unexpected event network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 for instance with vm_state building and task_state spawning.
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:19 user nova-compute[74638]: DEBUG nova.objects.instance [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'flavor' on Instance uuid 854bd78e-f3a1-4711-b880-56b0787eddf6 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:20:19 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Ignoring supplied device name: /dev/vdb
Nov 08 20:20:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG nova.network.neutron [req-46a78bf4-6607-450d-a986-1aa32ad0c00b req-cc30d97d-818d-4f19-a418-8cb1cd10c389 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Updated VIF entry in instance network info cache for port 84c5fdc8-faae-454a-9a74-a9ff4bd3136c. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG nova.network.neutron [req-46a78bf4-6607-450d-a986-1aa32ad0c00b req-cc30d97d-818d-4f19-a418-8cb1cd10c389 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Updating instance_info_cache with network_info: [{"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:20 user nova-compute[74638]: INFO nova.compute.manager [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Attaching volume 374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 to /dev/vdb
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-46a78bf4-6607-450d-a986-1aa32ad0c00b req-cc30d97d-818d-4f19-a418-8cb1cd10c389 service nova] Releasing lock "refresh_cache-854bd78e-f3a1-4711-b880-56b0787eddf6" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG os_brick.utils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8bad76-f8df-4800-ab3c-522ca50a28d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f5e0b1-937f-4035-89b6-02fee452fa43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bda932b-d2dc-423f-9849-8144b13537b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a2303c-878d-4e0a-aba1-6799a7f99f82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:20:20 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:20:20 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d63975-26b5-4d15-a58f-ecdd02fdbff1]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG os_brick.utils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:20:20 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Updating existing volume attachment record: 9c6416a4-a838-4681-93ca-d1d5cef2a2e1 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-97ff5298-6b0b-488c-a252-7eaf961a02fb req-75bd783e-018a-4595-a2b8-60228da52144 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received event network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97ff5298-6b0b-488c-a252-7eaf961a02fb req-75bd783e-018a-4595-a2b8-60228da52144 service nova] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97ff5298-6b0b-488c-a252-7eaf961a02fb req-75bd783e-018a-4595-a2b8-60228da52144 service nova] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97ff5298-6b0b-488c-a252-7eaf961a02fb req-75bd783e-018a-4595-a2b8-60228da52144 service nova] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-97ff5298-6b0b-488c-a252-7eaf961a02fb req-75bd783e-018a-4595-a2b8-60228da52144 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] No waiting events found dispatching network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:20:21 user nova-compute[74638]: WARNING nova.compute.manager [req-97ff5298-6b0b-488c-a252-7eaf961a02fb req-75bd783e-018a-4595-a2b8-60228da52144 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received unexpected event network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 for instance with vm_state building and task_state spawning.
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:20:21 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Instance spawned successfully.
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:22 user nova-compute[74638]: INFO nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 08 20:20:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:20:22 user nova-compute[74638]: INFO nova.compute.manager [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Took 7.04 seconds to build instance.
Nov 08 20:20:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b3fc9515-7979-415e-ada0-6f1fd180d895 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.160s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Port f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 binding to destination host user is already ACTIVE {{(pid=74638) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquired lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG nova.network.neutron [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating instance_info_cache with network_info: [{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Releasing lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG os_brick.utils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:20:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb3421c-922d-47bc-87f6-3ef770626239]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b0fe3-e063-45bc-b0e1-3628c25c7634]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bde898-9209-432a-a2ec-cfb136bf424c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3afc3c-8081-422d-8117-dbb0d5b35e3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:20:25 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:20:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdd92e-e0df-443e-b958-0a8c3ae95be9]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:20:25 user nova-compute[74638]: DEBUG os_brick.utils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:20:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:20:42 user nova-compute[74638]: INFO nova.compute.claims [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Claim successful on node user
Nov 08 20:20:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:20:42 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:20:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:20:42 user nova-compute[74638]: DEBUG nova.policy [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5d2a2e56dfc441ea12bfe9a89527a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad76637f4c184691893fc1c41cb6d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:20:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Creating image(s)
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.229s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk 1073741824" returned: 0 in 0.138s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.304s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:20:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Successfully created port: 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Cannot resize image /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Ensure instance console log exists: /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Successfully updated port: 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquired lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-8046ce5d-7a96-4267-be44-31681813e937 req-51a07237-dc2c-41bc-9976-c23d2cb03621 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-changed-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-8046ce5d-7a96-4267-be44-31681813e937 req-51a07237-dc2c-41bc-9976-c23d2cb03621 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Refreshing instance network info cache due to event network-changed-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8046ce5d-7a96-4267-be44-31681813e937 req-51a07237-dc2c-41bc-9976-c23d2cb03621 service nova] Acquiring lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:20:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.network.neutron [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating instance_info_cache with network_info: [{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Releasing lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance network_info: |[{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8046ce5d-7a96-4267-be44-31681813e937 req-51a07237-dc2c-41bc-9976-c23d2cb03621 service nova] Acquired lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-8046ce5d-7a96-4267-be44-31681813e937 req-51a07237-dc2c-41bc-9976-c23d2cb03621 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Refreshing network info cache for port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Start _get_guest_xml network_info=[{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:20:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:20:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1143454668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1143454668',id=26,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxzJ3KE50iQM0jwOCqCh4KQ/vzvRLl3tq/Ll6Ya0m8Ck/8f7/E3zGEiJKYPkSMgfZEV3PMQ7ob8StvEtDmGIaaKNNWNtdYc7UPFX2IyOl8478nhJBji0kZciyJQhhiUJg==',key_name='tempest-keypair-1222414860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-15l2jril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=0f9039b6-fc00-4956-ae26-a17f2886396b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:20:45 user nova-compute[74638]:   <uuid>0f9039b6-fc00-4956-ae26-a17f2886396b</uuid>
Nov 08 20:20:45 user nova-compute[74638]:   <name>instance-0000001a</name>
Nov 08 20:20:45 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:20:45 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:20:45 user nova-compute[74638]:   <metadata>
Nov 08 20:20:45 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:20:45 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:20:45 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1143454668</nova:name>
Nov 08 20:20:45 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:20:45</nova:creationTime>
Nov 08 20:20:45 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:20:45 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:20:45 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:20:45 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:20:45 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:20:45 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:20:45 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:20:45 user nova-compute[74638]:       <nova:owner>
Nov 08 20:20:45 user nova-compute[74638]:         <nova:user uuid="e5d2a2e56dfc441ea12bfe9a89527a2d">tempest-AttachVolumeShelveTestJSON-1349495348-project-member</nova:user>
Nov 08 20:20:45 user nova-compute[74638]:         <nova:project uuid="ad76637f4c184691893fc1c41cb6d08c">tempest-AttachVolumeShelveTestJSON-1349495348</nova:project>
Nov 08 20:20:45 user nova-compute[74638]:       </nova:owner>
Nov 08 20:20:45 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:20:45 user nova-compute[74638]:       <nova:ports>
Nov 08 20:20:45 user nova-compute[74638]:         <nova:port uuid="0355f8aa-41f3-4cd9-8c77-e0daf1a9959e">
Nov 08 20:20:45 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 20:20:45 user nova-compute[74638]:         </nova:port>
Nov 08 20:20:45 user nova-compute[74638]:       </nova:ports>
Nov 08 20:20:45 user nova-compute[74638]:     </nova:instance>
Nov 08 20:20:45 user nova-compute[74638]:   </metadata>
Nov 08 20:20:45 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:20:45 user nova-compute[74638]:     <system>
Nov 08 20:20:45 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:20:45 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:20:45 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:20:45 user nova-compute[74638]:       <entry name="serial">0f9039b6-fc00-4956-ae26-a17f2886396b</entry>
Nov 08 20:20:45 user nova-compute[74638]:       <entry name="uuid">0f9039b6-fc00-4956-ae26-a17f2886396b</entry>
Nov 08 20:20:45 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:20:45 user nova-compute[74638]:     </system>
Nov 08 20:20:45 user nova-compute[74638]:   </sysinfo>
Nov 08 20:20:45 user nova-compute[74638]:   <os>
Nov 08 20:20:45 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:20:45 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:20:45 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:20:45 user nova-compute[74638]:   </os>
Nov 08 20:20:45 user nova-compute[74638]:   <features>
Nov 08 20:20:45 user nova-compute[74638]:     <acpi/>
Nov 08 20:20:45 user nova-compute[74638]:     <apic/>
Nov 08 20:20:45 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:20:45 user nova-compute[74638]:   </features>
Nov 08 20:20:45 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:20:45 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:20:45 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:20:45 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:20:45 user nova-compute[74638]:   </clock>
Nov 08 20:20:45 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:20:45 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:20:45 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:20:45 user nova-compute[74638]:   </cpu>
Nov 08 20:20:45 user nova-compute[74638]:   <devices>
Nov 08 20:20:45 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:20:45 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:20:45 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk"/>
Nov 08 20:20:45 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:20:45 user nova-compute[74638]:     </disk>
Nov 08 20:20:45 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:20:45 user nova-compute[74638]:       <mac address="fa:16:3e:e8:d2:87"/>
Nov 08 20:20:45 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:20:45 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:20:45 user nova-compute[74638]:       <target dev="tap0355f8aa-41"/>
Nov 08 20:20:45 user nova-compute[74638]:     </interface>
Nov 08 20:20:45 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:20:45 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/console.log" append="off"/>
Nov 08 20:20:45 user nova-compute[74638]:     </serial>
Nov 08 20:20:45 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:20:45 user nova-compute[74638]:     <video>
Nov 08 20:20:45 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:20:45 user nova-compute[74638]:     </video>
Nov 08 20:20:45 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:20:45 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:20:45 user nova-compute[74638]:     </rng>
Nov 08 20:20:45 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:20:45 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:20:45 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:20:45 user nova-compute[74638]:     </memballoon>
Nov 08 20:20:45 user nova-compute[74638]:   </devices>
Nov 08 20:20:45 user nova-compute[74638]: </domain>
Nov 08 20:20:45 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1143454668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1143454668',id=26,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxzJ3KE50iQM0jwOCqCh4KQ/vzvRLl3tq/Ll6Ya0m8Ck/8f7/E3zGEiJKYPkSMgfZEV3PMQ7ob8StvEtDmGIaaKNNWNtdYc7UPFX2IyOl8478nhJBji0kZciyJQhhiUJg==',key_name='tempest-keypair-1222414860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-15l2jril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=0f9039b6-fc00-4956-ae26-a17f2886396b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG os_vif [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d44b95a-4c63-525c-98cc-426fabd4619e', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0355f8aa-41, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0355f8aa-41, col_values=(('qos', UUID('fec9e5bc-89ba-4dde-a5a4-89fbf26aee8c')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0355f8aa-41, col_values=(('external_ids', {'iface-id': '0355f8aa-41f3-4cd9-8c77-e0daf1a9959e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:d2:87', 'vm-uuid': '0f9039b6-fc00-4956-ae26-a17f2886396b'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:45 user nova-compute[74638]: INFO os_vif [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41')
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No VIF found with MAC fa:16:3e:e8:d2:87, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-8046ce5d-7a96-4267-be44-31681813e937 req-51a07237-dc2c-41bc-9976-c23d2cb03621 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updated VIF entry in instance network info cache for port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-8046ce5d-7a96-4267-be44-31681813e937 req-51a07237-dc2c-41bc-9976-c23d2cb03621 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating instance_info_cache with network_info: [{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:20:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8046ce5d-7a96-4267-be44-31681813e937 req-51a07237-dc2c-41bc-9976-c23d2cb03621 service nova] Releasing lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:20:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-dd8b2a96-1b57-411a-84d6-45eac7064c8e req-6b02e7b2-372a-4e83-a97b-36679bac0bc2 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dd8b2a96-1b57-411a-84d6-45eac7064c8e req-6b02e7b2-372a-4e83-a97b-36679bac0bc2 service nova] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dd8b2a96-1b57-411a-84d6-45eac7064c8e req-6b02e7b2-372a-4e83-a97b-36679bac0bc2 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dd8b2a96-1b57-411a-84d6-45eac7064c8e req-6b02e7b2-372a-4e83-a97b-36679bac0bc2 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-dd8b2a96-1b57-411a-84d6-45eac7064c8e req-6b02e7b2-372a-4e83-a97b-36679bac0bc2 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] No waiting events found dispatching network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:20:47 user nova-compute[74638]: WARNING nova.compute.manager [req-dd8b2a96-1b57-411a-84d6-45eac7064c8e req-6b02e7b2-372a-4e83-a97b-36679bac0bc2 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received unexpected event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e for instance with vm_state building and task_state spawning.
Nov 08 20:20:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbtJKHlE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:20:48 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:20:48 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:20:48 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89f0066-166d-4e8e-b8af-4e1c8f4e225d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:20:48 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece166b-f678-4f73-b3d9-65dd035573e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07] added
Nov 08 20:20:48 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a79b0e6-d803-4c5e-9076-8054033c2d63]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3235fce-8b61-4ef1-bfeb-2be863489ee6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbtJKHlE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbtJKHlE" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c21c7a-847b-46ed-a958-2502de1b5450]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fbtJKHlE'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d1ab2b-cb4f-47b0-bda3-115a8708b040]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c154723-ca05-4ced-86b6-f27d429311bb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:20:48 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:20:48 user nova-compute[74638]:  {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:20:48 user nova-compute[74638]: WARNING os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 20:20:48 user nova-compute[74638]: 
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04c9443-9103-41b3-8bd8-b18ceb9d856a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07, portal: 172.16.0.220,3260]
Nov 08 20:20:48 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07, portal: 172.16.0.220,3260] successful.
Nov 08 20:20:48 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87286ab-23ea-4c32-844d-be72b0916a66]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ab6a0-ab4a-4b20-8554-5ab0c61b8f06]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:20:48 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:20:48 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf70245-30bc-41bb-9a03-7492eac48259]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbtJKHlE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:20:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:20:49 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance spawned successfully.
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-ce27b9ee-4f35-4e91-aa70-e29ba05b7e13 req-0f15639b-56e1-4982-ba10-ce62864bf975 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ce27b9ee-4f35-4e91-aa70-e29ba05b7e13 req-0f15639b-56e1-4982-ba10-ce62864bf975 service nova] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ce27b9ee-4f35-4e91-aa70-e29ba05b7e13 req-0f15639b-56e1-4982-ba10-ce62864bf975 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ce27b9ee-4f35-4e91-aa70-e29ba05b7e13 req-0f15639b-56e1-4982-ba10-ce62864bf975 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-ce27b9ee-4f35-4e91-aa70-e29ba05b7e13 req-0f15639b-56e1-4982-ba10-ce62864bf975 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] No waiting events found dispatching network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:20:49 user nova-compute[74638]: WARNING nova.compute.manager [req-ce27b9ee-4f35-4e91-aa70-e29ba05b7e13 req-0f15639b-56e1-4982-ba10-ce62864bf975 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received unexpected event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e for instance with vm_state building and task_state spawning.
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26663646436626338', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663646436626338', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:20:49 user nova-compute[74638]: INFO nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.objects.instance [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'flavor' on Instance uuid 854bd78e-f3a1-4711-b880-56b0787eddf6 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:20:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:20:49 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:20:49 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:20:49 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:20:49 user nova-compute[74638]:   <serial>374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07</serial>
Nov 08 20:20:49 user nova-compute[74638]: </disk>
Nov 08 20:20:49 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:20:49 user nova-compute[74638]: INFO nova.compute.manager [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Took 7.68 seconds to build instance.
Nov 08 20:20:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-635c106e-e89b-414b-959c-ffd602218ebb tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.825s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:20:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:20:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No VIF found with MAC fa:16:3e:aa:18:95, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:20:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-260fb6fd-cfe1-4cc0-9ee1-604d01eb337f tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.274s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Starting finish_migration {{(pid=74638) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance directory exists: not creating {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 20:20:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Creating image(s)
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Ensure instance console log exists: /opt/stack/data/nova/instances/491aafd0-a4dd-4cb2-9584-e88c39367878/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Start _get_guest_xml network_info=[{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-704165763-network", "vif_mac": "fa:16:3e:84:fe:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '4f1510d7-6e67-489d-a5f7-8147f0a9bd6c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJThDUgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '491aafd0-a4dd-4cb2-9584-e88c39367878', 'attached_at': '2023-11-08T20:20:55.000000', 'detached_at': '', 'volume_id': '30e7f9f1-0309-4a06-8485-93af26b5674b', 'serial': '30e7f9f1-0309-4a06-8485-93af26b5674b'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:20:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:20:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJThDUgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:20:54 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:20:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:20:54 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:20:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:20:54 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c258c4-07aa-4cdc-a22d-b38c5ebf66c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:20:54 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9484a0a2-d5f9-4766-9c13-c587abb4513a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b] added
Nov 08 20:20:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a6745-259a-4e79-916c-b931369e10ad]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03b0cc-21c9-452d-bcbc-67337d94075c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJThDUgx {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJThDUgx" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[df598d1f-4461-4c19-9010-d6bb7592cad3]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJThDUgx'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780ab34-6602-43bd-ac27-471714958411]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2185074-c76a-4c02-a741-1276195ca233]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:20:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:20:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa8cb70-98ab-4f4f-afe2-35b2672ca008]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260]
Nov 08 20:20:55 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260] successful.
Nov 08 20:20:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1ec3d6-0f16-40f1-adcd-a5e3fc44e685]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caeed03-754e-4052-9c32-5c29ed38ada3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:20:55 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:20:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:20:55 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:20:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4641c9-09dd-4644-aff2-e067a2432a34]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJThDUgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:55 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23836643330333462', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836643330333462', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-912749548',display_name='tempest-ServerActionsTestOtherA-server-912749548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-912749548',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-qrmph4tl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=491aafd0-a4dd-4cb2-9584-e88c39367878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-704165763-network", "vif_mac": "fa:16:3e:84:fe:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-704165763-network", "vif_mac": "fa:16:3e:84:fe:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:20:56 user nova-compute[74638]:   <uuid>491aafd0-a4dd-4cb2-9584-e88c39367878</uuid>
Nov 08 20:20:56 user nova-compute[74638]:   <name>instance-00000015</name>
Nov 08 20:20:56 user nova-compute[74638]:   <memory>2097152</memory>
Nov 08 20:20:56 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:20:56 user nova-compute[74638]:   <metadata>
Nov 08 20:20:56 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:20:56 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:20:56 user nova-compute[74638]:       <nova:name>tempest-ServerActionsTestOtherA-server-912749548</nova:name>
Nov 08 20:20:56 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:20:54</nova:creationTime>
Nov 08 20:20:56 user nova-compute[74638]:       <nova:flavor name="m1.small">
Nov 08 20:20:56 user nova-compute[74638]:         <nova:memory>2048</nova:memory>
Nov 08 20:20:56 user nova-compute[74638]:         <nova:disk>20</nova:disk>
Nov 08 20:20:56 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:20:56 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:20:56 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:20:56 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:20:56 user nova-compute[74638]:       <nova:owner>
Nov 08 20:20:56 user nova-compute[74638]:         <nova:user uuid="fc302495f45a4ae1bd2524aa60ecbc85">tempest-ServerActionsTestOtherA-1281886616-project-member</nova:user>
Nov 08 20:20:56 user nova-compute[74638]:         <nova:project uuid="4d0b2492206349f197739ee10c95a28f">tempest-ServerActionsTestOtherA-1281886616</nova:project>
Nov 08 20:20:56 user nova-compute[74638]:       </nova:owner>
Nov 08 20:20:56 user nova-compute[74638]:       <nova:ports>
Nov 08 20:20:56 user nova-compute[74638]:         <nova:port uuid="f0b1c9dd-a527-44b2-b88d-cf428bf72ba7">
Nov 08 20:20:56 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 20:20:56 user nova-compute[74638]:         </nova:port>
Nov 08 20:20:56 user nova-compute[74638]:       </nova:ports>
Nov 08 20:20:56 user nova-compute[74638]:     </nova:instance>
Nov 08 20:20:56 user nova-compute[74638]:   </metadata>
Nov 08 20:20:56 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:20:56 user nova-compute[74638]:     <system>
Nov 08 20:20:56 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:20:56 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:20:56 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:20:56 user nova-compute[74638]:       <entry name="serial">491aafd0-a4dd-4cb2-9584-e88c39367878</entry>
Nov 08 20:20:56 user nova-compute[74638]:       <entry name="uuid">491aafd0-a4dd-4cb2-9584-e88c39367878</entry>
Nov 08 20:20:56 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:20:56 user nova-compute[74638]:     </system>
Nov 08 20:20:56 user nova-compute[74638]:   </sysinfo>
Nov 08 20:20:56 user nova-compute[74638]:   <os>
Nov 08 20:20:56 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:20:56 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:20:56 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:20:56 user nova-compute[74638]:   </os>
Nov 08 20:20:56 user nova-compute[74638]:   <features>
Nov 08 20:20:56 user nova-compute[74638]:     <acpi/>
Nov 08 20:20:56 user nova-compute[74638]:     <apic/>
Nov 08 20:20:56 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:20:56 user nova-compute[74638]:   </features>
Nov 08 20:20:56 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:20:56 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:20:56 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:20:56 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:20:56 user nova-compute[74638]:   </clock>
Nov 08 20:20:56 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:20:56 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:20:56 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:20:56 user nova-compute[74638]:   </cpu>
Nov 08 20:20:56 user nova-compute[74638]:   <devices>
Nov 08 20:20:56 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:20:56 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:20:56 user nova-compute[74638]:       <source dev="/dev/sdc"/>
Nov 08 20:20:56 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:20:56 user nova-compute[74638]:       <serial>30e7f9f1-0309-4a06-8485-93af26b5674b</serial>
Nov 08 20:20:56 user nova-compute[74638]:     </disk>
Nov 08 20:20:56 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:20:56 user nova-compute[74638]:       <mac address="fa:16:3e:84:fe:6f"/>
Nov 08 20:20:56 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:20:56 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:20:56 user nova-compute[74638]:       <target dev="tapf0b1c9dd-a5"/>
Nov 08 20:20:56 user nova-compute[74638]:     </interface>
Nov 08 20:20:56 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:20:56 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/491aafd0-a4dd-4cb2-9584-e88c39367878/console.log" append="off"/>
Nov 08 20:20:56 user nova-compute[74638]:     </serial>
Nov 08 20:20:56 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:20:56 user nova-compute[74638]:     <video>
Nov 08 20:20:56 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:20:56 user nova-compute[74638]:     </video>
Nov 08 20:20:56 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:20:56 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:20:56 user nova-compute[74638]:     </rng>
Nov 08 20:20:56 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:20:56 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:20:56 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:20:56 user nova-compute[74638]:     </memballoon>
Nov 08 20:20:56 user nova-compute[74638]:   </devices>
Nov 08 20:20:56 user nova-compute[74638]: </domain>
Nov 08 20:20:56 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-912749548',display_name='tempest-ServerActionsTestOtherA-server-912749548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-912749548',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-qrmph4tl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=491aafd0-a4dd-4cb2-9584-e88c39367878,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-704165763-network", "vif_mac": "fa:16:3e:84:fe:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-704165763-network", "vif_mac": "fa:16:3e:84:fe:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG os_vif [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f5720c4-0d2a-56fa-bfd0-0ad61777cd77', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0b1c9dd-a5, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0b1c9dd-a5, col_values=(('qos', UUID('d4f9f584-fc5a-4b39-b25f-c0c6d0ade02b')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0b1c9dd-a5, col_values=(('external_ids', {'iface-id': 'f0b1c9dd-a527-44b2-b88d-cf428bf72ba7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:fe:6f', 'vm-uuid': '491aafd0-a4dd-4cb2-9584-e88c39367878'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:56 user nova-compute[74638]: INFO os_vif [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5')
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:20:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] No VIF found with MAC fa:16:3e:84:fe:6f, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:20:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-005b5acb-b9a1-4a94-8b35-decd2d6f1982 req-7498e39f-7f1c-4330-81f5-3123c7e53f20 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-005b5acb-b9a1-4a94-8b35-decd2d6f1982 req-7498e39f-7f1c-4330-81f5-3123c7e53f20 service nova] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-005b5acb-b9a1-4a94-8b35-decd2d6f1982 req-7498e39f-7f1c-4330-81f5-3123c7e53f20 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-005b5acb-b9a1-4a94-8b35-decd2d6f1982 req-7498e39f-7f1c-4330-81f5-3123c7e53f20 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:20:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-005b5acb-b9a1-4a94-8b35-decd2d6f1982 req-7498e39f-7f1c-4330-81f5-3123c7e53f20 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] No waiting events found dispatching network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:20:58 user nova-compute[74638]: WARNING nova.compute.manager [req-005b5acb-b9a1-4a94-8b35-decd2d6f1982 req-7498e39f-7f1c-4330-81f5-3123c7e53f20 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received unexpected event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 for instance with vm_state active and task_state resize_finish.
Nov 08 20:20:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-b5a66bf5-253d-46d6-93fa-439c0918ae14 req-13abaa8b-fdfd-45e4-9c87-ca9c3f689ae3 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b5a66bf5-253d-46d6-93fa-439c0918ae14 req-13abaa8b-fdfd-45e4-9c87-ca9c3f689ae3 service nova] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b5a66bf5-253d-46d6-93fa-439c0918ae14 req-13abaa8b-fdfd-45e4-9c87-ca9c3f689ae3 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b5a66bf5-253d-46d6-93fa-439c0918ae14 req-13abaa8b-fdfd-45e4-9c87-ca9c3f689ae3 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-b5a66bf5-253d-46d6-93fa-439c0918ae14 req-13abaa8b-fdfd-45e4-9c87-ca9c3f689ae3 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] No waiting events found dispatching network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:21:00 user nova-compute[74638]: WARNING nova.compute.manager [req-b5a66bf5-253d-46d6-93fa-439c0918ae14 req-13abaa8b-fdfd-45e4-9c87-ca9c3f689ae3 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received unexpected event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 for instance with vm_state active and task_state resize_finish.
Nov 08 20:21:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:21:00 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance running successfully.
Nov 08 20:21:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Failed to set time: agent not configured {{(pid=74638) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 20:21:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0b3c2302-80c6-4e3c-b5fd-b2675b5e8b33 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] finish_migration finished successfully. {{(pid=74638) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 20:21:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:01 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:21:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:21:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:21:02 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:21:03 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updating instance_info_cache with network_info: [{"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:21:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:21:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:21:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:21:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:04 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:21:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:21:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:21:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:21:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7642MB free_disk=25.445388793945312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Applying migration context for instance 491aafd0-a4dd-4cb2-9584-e88c39367878 as it has an incoming, in-progress migration 11cf525b-1dd9-479e-ad68-9e2972eb2503. Migration status is finished {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 20:21:09 user nova-compute[74638]: INFO nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating resource usage from migration 11cf525b-1dd9-479e-ad68-9e2972eb2503
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5ec97bac-185e-4959-b763-6514faef8e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 854bd78e-f3a1-4711-b880-56b0787eddf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Migration 11cf525b-1dd9-479e-ad68-9e2972eb2503 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 491aafd0-a4dd-4cb2-9584-e88c39367878 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0f9039b6-fc00-4956-ae26-a17f2886396b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:21:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:21:10 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:21:10 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:21:10 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:21:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYnSxbHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:21:16 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:21:16 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:21:16 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7f34cd-db44-4ee6-8cbc-9f3916faea82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:21:16 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7049bf4f-b27d-4e01-949d-4d32c4fdf0b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8] added
Nov 08 20:21:16 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a857fa-33fb-4bc1-9eb0-c4e7f8aed59f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[459321cf-7257-4580-ace1-8568571a06a2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYnSxbHf {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYnSxbHf" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1418261-be59-496f-b5b0-ff7848f18b91]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PYnSxbHf'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:21:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ce663f-b127-4678-aa24-2da03ed33e83]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[516f8260-6521-475b-b9cb-4a3d22cb567e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:21:17 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:21:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:21:17 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:21:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d03a0f5-a994-4f22-af6a-9d9fddd7fb25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8, portal: 172.16.0.220,3260]
Nov 08 20:21:17 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8, portal: 172.16.0.220,3260] successful.
Nov 08 20:21:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5695c96-4a6b-4fda-932c-e75be2153094]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a188bf96-d013-49cf-b085-0fa87011edd1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:21:17 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:21:17 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:21:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:21:17 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:21:17 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:21:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[80716b8a-fb15-47ca-a83e-cbc30d46c428]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYnSxbHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23363366165346138', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363366165346138', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG nova.objects.instance [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:21:18 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:21:18 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:21:18 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:21:18 user nova-compute[74638]:   <serial>28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8</serial>
Nov 08 20:21:18 user nova-compute[74638]: </disk>
Nov 08 20:21:18 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No VIF found with MAC fa:16:3e:1a:22:68, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-af8ef210-4f24-41af-b078-5daa3e50d20f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 59.524s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:29 user nova-compute[74638]: INFO nova.compute.manager [None req-e72d4a54-b9d7-4070-85fc-9816ba423175 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Unrescuing
Nov 08 20:21:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e72d4a54-b9d7-4070-85fc-9816ba423175 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:21:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e72d4a54-b9d7-4070-85fc-9816ba423175 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquired lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:21:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e72d4a54-b9d7-4070-85fc-9816ba423175 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:21:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e72d4a54-b9d7-4070-85fc-9816ba423175 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updating instance_info_cache with network_info: [{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e72d4a54-b9d7-4070-85fc-9816ba423175 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Releasing lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG nova.objects.instance [None req-e72d4a54-b9d7-4070-85fc-9816ba423175 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'flavor' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-4dd01357-3366-4c4b-a2dd-86f31efd2dff req-787ce6ed-18b2-481c-8ba3-31ab1278cd3a service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4dd01357-3366-4c4b-a2dd-86f31efd2dff req-787ce6ed-18b2-481c-8ba3-31ab1278cd3a service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4dd01357-3366-4c4b-a2dd-86f31efd2dff req-787ce6ed-18b2-481c-8ba3-31ab1278cd3a service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4dd01357-3366-4c4b-a2dd-86f31efd2dff req-787ce6ed-18b2-481c-8ba3-31ab1278cd3a service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-4dd01357-3366-4c4b-a2dd-86f31efd2dff req-787ce6ed-18b2-481c-8ba3-31ab1278cd3a service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:21:30 user nova-compute[74638]: WARNING nova.compute.manager [req-4dd01357-3366-4c4b-a2dd-86f31efd2dff req-787ce6ed-18b2-481c-8ba3-31ab1278cd3a service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:21:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:30 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance destroyed successfully.
Nov 08 20:21:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:21:32 user nova-compute[74638]: WARNING nova.compute.manager [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:21:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:21:32 user nova-compute[74638]: WARNING nova.compute.manager [req-71aea79b-fa13-4b7d-9787-c5abe73192e9 req-288a393f-79bd-40e8-ad05-a9b190d96364 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:21:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-1e4953e1-9e56-4779-bed2-9f1aa3806d4c req-a3dde45d-16a4-49c9-b2e6-7f8102eadf6e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Received event network-changed-a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-1e4953e1-9e56-4779-bed2-9f1aa3806d4c req-a3dde45d-16a4-49c9-b2e6-7f8102eadf6e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Refreshing instance network info cache due to event network-changed-a69986fb-6b77-46b9-a993-b37e8a9dbb67. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1e4953e1-9e56-4779-bed2-9f1aa3806d4c req-a3dde45d-16a4-49c9-b2e6-7f8102eadf6e service nova] Acquiring lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1e4953e1-9e56-4779-bed2-9f1aa3806d4c req-a3dde45d-16a4-49c9-b2e6-7f8102eadf6e service nova] Acquired lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:21:32 user nova-compute[74638]: DEBUG nova.network.neutron [req-1e4953e1-9e56-4779-bed2-9f1aa3806d4c req-a3dde45d-16a4-49c9-b2e6-7f8102eadf6e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Refreshing network info cache for port a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG nova.network.neutron [req-1e4953e1-9e56-4779-bed2-9f1aa3806d4c req-a3dde45d-16a4-49c9-b2e6-7f8102eadf6e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Updated VIF entry in instance network info cache for port a69986fb-6b77-46b9-a993-b37e8a9dbb67. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG nova.network.neutron [req-1e4953e1-9e56-4779-bed2-9f1aa3806d4c req-a3dde45d-16a4-49c9-b2e6-7f8102eadf6e service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Updating instance_info_cache with network_info: [{"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "0e529715-d390-4929-998f-5835de148256" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1e4953e1-9e56-4779-bed2-9f1aa3806d4c req-a3dde45d-16a4-49c9-b2e6-7f8102eadf6e service nova] Releasing lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'flavor' on Instance uuid 0e529715-d390-4929-998f-5835de148256 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "0e529715-d390-4929-998f-5835de148256" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:33 user nova-compute[74638]: INFO nova.compute.manager [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Attaching volume f58b93bc-4ed3-4d92-af66-2c89c3d0926c to /dev/vdb
Nov 08 20:21:33 user nova-compute[74638]: DEBUG os_brick.utils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a0ead0-2eee-43ce-9388-23e85402cfde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fae0c34-cc33-45a9-a532-3539a46cd735]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e333cc28-88c2-45ee-bd04-8a935c408f58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11d0638-d376-41f8-8519-86739ac07520]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:21:33 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1852552c-5e37-4748-9b37-04050586c832]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG os_brick.utils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Updating existing volume attachment record: 6ca84904-aeaa-48e0-9448-c60b8611c0a1 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:21:34 user nova-compute[74638]: INFO nova.compute.claims [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Claim successful on node user
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e72d4a54-b9d7-4070-85fc-9816ba423175 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-e5fe7d5d-0f57-4f81-93cb-1f11a16faa91 req-78acadf1-ab7d-43a9-a276-151825a71f3c service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5fe7d5d-0f57-4f81-93cb-1f11a16faa91 req-78acadf1-ab7d-43a9-a276-151825a71f3c service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5fe7d5d-0f57-4f81-93cb-1f11a16faa91 req-78acadf1-ab7d-43a9-a276-151825a71f3c service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5fe7d5d-0f57-4f81-93cb-1f11a16faa91 req-78acadf1-ab7d-43a9-a276-151825a71f3c service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-e5fe7d5d-0f57-4f81-93cb-1f11a16faa91 req-78acadf1-ab7d-43a9-a276-151825a71f3c service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:21:34 user nova-compute[74638]: WARNING nova.compute.manager [req-e5fe7d5d-0f57-4f81-93cb-1f11a16faa91 req-78acadf1-ab7d-43a9-a276-151825a71f3c service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state active and task_state None.
Nov 08 20:21:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:21:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Creating image(s)
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "/opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "/opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:34 user nova-compute[74638]: DEBUG nova.policy [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f4f864db53145f9b90149220d5b006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8922bc53038a407ca3fa2c5840075a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.259s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk 1073741824" returned: 0 in 0.054s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Successfully created port: 603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Cannot resize image /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Ensure instance console log exists: /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.211s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:36 user nova-compute[74638]: INFO nova.compute.manager [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Attaching volume 9271585f-3819-43a9-97d2-24625a93a281 to /dev/vdc
Nov 08 20:21:36 user nova-compute[74638]: DEBUG os_brick.utils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0268ae-5d5c-42d6-a912-64c43fbd541e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1c685c-95db-4e16-af8b-cd23a360a272]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3a2799-85b1-475c-b8bd-412fda4a327f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab07ca-71eb-417b-a61b-f85bbf02fe6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:21:36 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[132ba710-43ef-4807-a0d8-12a7a973042e]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG os_brick.utils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updating existing volume attachment record: b1f2cc03-c09b-473a-98f1-0170228e1ba6 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Successfully updated port: 603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "refresh_cache-ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquired lock "refresh_cache-ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-6b2d0c98-d5d3-47a7-af6c-11b602797bc8 req-1f436f94-9919-4967-bb2e-d4d5e04dbc2a service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-changed-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-6b2d0c98-d5d3-47a7-af6c-11b602797bc8 req-1f436f94-9919-4967-bb2e-d4d5e04dbc2a service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Refreshing instance network info cache due to event network-changed-603a1b6a-576a-4c7d-84f6-92c46f640a53. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6b2d0c98-d5d3-47a7-af6c-11b602797bc8 req-1f436f94-9919-4967-bb2e-d4d5e04dbc2a service nova] Acquiring lock "refresh_cache-ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Updating instance_info_cache with network_info: [{"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Releasing lock "refresh_cache-ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Instance network_info: |[{"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6b2d0c98-d5d3-47a7-af6c-11b602797bc8 req-1f436f94-9919-4967-bb2e-d4d5e04dbc2a service nova] Acquired lock "refresh_cache-ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:21:36 user nova-compute[74638]: DEBUG nova.network.neutron [req-6b2d0c98-d5d3-47a7-af6c-11b602797bc8 req-1f436f94-9919-4967-bb2e-d4d5e04dbc2a service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Refreshing network info cache for port 603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Start _get_guest_xml network_info=[{"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:21:37 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:21:37 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1782531075',display_name='tempest-VolumesNegativeTest-instance-1782531075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1782531075',id=27,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8922bc53038a407ca3fa2c5840075a68',ramdisk_id='',reservation_id='r-f5hn0qja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1354114148',owner_user_name='tempest-VolumesNegativeTest-1354114148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:21:35Z,user_data=None,user_id='8f4f864db53145f9b90149220d5b006b',uuid=ca4173af-55e0-4bfd-9c9f-6b6c59a18f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Converting VIF {"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:d3,bridge_name='br-int',has_traffic_filtering=True,id=603a1b6a-576a-4c7d-84f6-92c46f640a53,network=Network(9442ac35-8c8a-4e97-a9d4-d2e4f87144b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603a1b6a-57') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.objects.instance [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lazy-loading 'pci_devices' on Instance uuid ca4173af-55e0-4bfd-9c9f-6b6c59a18f49 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:21:37 user nova-compute[74638]:   <uuid>ca4173af-55e0-4bfd-9c9f-6b6c59a18f49</uuid>
Nov 08 20:21:37 user nova-compute[74638]:   <name>instance-0000001b</name>
Nov 08 20:21:37 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:21:37 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:21:37 user nova-compute[74638]:   <metadata>
Nov 08 20:21:37 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:21:37 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:21:37 user nova-compute[74638]:       <nova:name>tempest-VolumesNegativeTest-instance-1782531075</nova:name>
Nov 08 20:21:37 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:21:37</nova:creationTime>
Nov 08 20:21:37 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:21:37 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:21:37 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:21:37 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:21:37 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:21:37 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:21:37 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:21:37 user nova-compute[74638]:       <nova:owner>
Nov 08 20:21:37 user nova-compute[74638]:         <nova:user uuid="8f4f864db53145f9b90149220d5b006b">tempest-VolumesNegativeTest-1354114148-project-member</nova:user>
Nov 08 20:21:37 user nova-compute[74638]:         <nova:project uuid="8922bc53038a407ca3fa2c5840075a68">tempest-VolumesNegativeTest-1354114148</nova:project>
Nov 08 20:21:37 user nova-compute[74638]:       </nova:owner>
Nov 08 20:21:37 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:21:37 user nova-compute[74638]:       <nova:ports>
Nov 08 20:21:37 user nova-compute[74638]:         <nova:port uuid="603a1b6a-576a-4c7d-84f6-92c46f640a53">
Nov 08 20:21:37 user nova-compute[74638]:           <nova:ip type="fixed" address="192.168.233.204" ipVersion="4"/>
Nov 08 20:21:37 user nova-compute[74638]:         </nova:port>
Nov 08 20:21:37 user nova-compute[74638]:       </nova:ports>
Nov 08 20:21:37 user nova-compute[74638]:     </nova:instance>
Nov 08 20:21:37 user nova-compute[74638]:   </metadata>
Nov 08 20:21:37 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:21:37 user nova-compute[74638]:     <system>
Nov 08 20:21:37 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:21:37 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:21:37 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:21:37 user nova-compute[74638]:       <entry name="serial">ca4173af-55e0-4bfd-9c9f-6b6c59a18f49</entry>
Nov 08 20:21:37 user nova-compute[74638]:       <entry name="uuid">ca4173af-55e0-4bfd-9c9f-6b6c59a18f49</entry>
Nov 08 20:21:37 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:21:37 user nova-compute[74638]:     </system>
Nov 08 20:21:37 user nova-compute[74638]:   </sysinfo>
Nov 08 20:21:37 user nova-compute[74638]:   <os>
Nov 08 20:21:37 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:21:37 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:21:37 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:21:37 user nova-compute[74638]:   </os>
Nov 08 20:21:37 user nova-compute[74638]:   <features>
Nov 08 20:21:37 user nova-compute[74638]:     <acpi/>
Nov 08 20:21:37 user nova-compute[74638]:     <apic/>
Nov 08 20:21:37 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:21:37 user nova-compute[74638]:   </features>
Nov 08 20:21:37 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:21:37 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:21:37 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:21:37 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:21:37 user nova-compute[74638]:   </clock>
Nov 08 20:21:37 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:21:37 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:21:37 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:21:37 user nova-compute[74638]:   </cpu>
Nov 08 20:21:37 user nova-compute[74638]:   <devices>
Nov 08 20:21:37 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:21:37 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:21:37 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk"/>
Nov 08 20:21:37 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:21:37 user nova-compute[74638]:     </disk>
Nov 08 20:21:37 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:21:37 user nova-compute[74638]:       <mac address="fa:16:3e:3f:55:d3"/>
Nov 08 20:21:37 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:21:37 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:21:37 user nova-compute[74638]:       <target dev="tap603a1b6a-57"/>
Nov 08 20:21:37 user nova-compute[74638]:     </interface>
Nov 08 20:21:37 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:21:37 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/console.log" append="off"/>
Nov 08 20:21:37 user nova-compute[74638]:     </serial>
Nov 08 20:21:37 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:21:37 user nova-compute[74638]:     <video>
Nov 08 20:21:37 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:21:37 user nova-compute[74638]:     </video>
Nov 08 20:21:37 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:21:37 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:21:37 user nova-compute[74638]:     </rng>
Nov 08 20:21:37 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:21:37 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:21:37 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:21:37 user nova-compute[74638]:     </memballoon>
Nov 08 20:21:37 user nova-compute[74638]:   </devices>
Nov 08 20:21:37 user nova-compute[74638]: </domain>
Nov 08 20:21:37 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1782531075',display_name='tempest-VolumesNegativeTest-instance-1782531075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1782531075',id=27,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8922bc53038a407ca3fa2c5840075a68',ramdisk_id='',reservation_id='r-f5hn0qja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1354114148',owner_user_name='tempest-VolumesNegativeTest-1354114148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:21:35Z,user_data=None,user_id='8f4f864db53145f9b90149220d5b006b',uuid=ca4173af-55e0-4bfd-9c9f-6b6c59a18f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Converting VIF {"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:d3,bridge_name='br-int',has_traffic_filtering=True,id=603a1b6a-576a-4c7d-84f6-92c46f640a53,network=Network(9442ac35-8c8a-4e97-a9d4-d2e4f87144b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603a1b6a-57') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG os_vif [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:d3,bridge_name='br-int',has_traffic_filtering=True,id=603a1b6a-576a-4c7d-84f6-92c46f640a53,network=Network(9442ac35-8c8a-4e97-a9d4-d2e4f87144b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603a1b6a-57') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b684d07-8541-5be1-90c8-7516fa12e6f8', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap603a1b6a-57, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap603a1b6a-57, col_values=(('qos', UUID('a6a256f8-bcb0-4710-b44d-c8cbd4d7f238')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap603a1b6a-57, col_values=(('external_ids', {'iface-id': '603a1b6a-576a-4c7d-84f6-92c46f640a53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:55:d3', 'vm-uuid': 'ca4173af-55e0-4bfd-9c9f-6b6c59a18f49'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:37 user nova-compute[74638]: INFO os_vif [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:d3,bridge_name='br-int',has_traffic_filtering=True,id=603a1b6a-576a-4c7d-84f6-92c46f640a53,network=Network(9442ac35-8c8a-4e97-a9d4-d2e4f87144b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603a1b6a-57')
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] No VIF found with MAC fa:16:3e:3f:55:d3, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.network.neutron [req-6b2d0c98-d5d3-47a7-af6c-11b602797bc8 req-1f436f94-9919-4967-bb2e-d4d5e04dbc2a service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Updated VIF entry in instance network info cache for port 603a1b6a-576a-4c7d-84f6-92c46f640a53. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG nova.network.neutron [req-6b2d0c98-d5d3-47a7-af6c-11b602797bc8 req-1f436f94-9919-4967-bb2e-d4d5e04dbc2a service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Updating instance_info_cache with network_info: [{"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:21:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6b2d0c98-d5d3-47a7-af6c-11b602797bc8 req-1f436f94-9919-4967-bb2e-d4d5e04dbc2a service nova] Releasing lock "refresh_cache-ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:21:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-80b0f549-c07e-4d65-abbd-e5326e2b5518 req-632bed8b-47d3-46e9-8f56-66651ce3af51 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-80b0f549-c07e-4d65-abbd-e5326e2b5518 req-632bed8b-47d3-46e9-8f56-66651ce3af51 service nova] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-80b0f549-c07e-4d65-abbd-e5326e2b5518 req-632bed8b-47d3-46e9-8f56-66651ce3af51 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-80b0f549-c07e-4d65-abbd-e5326e2b5518 req-632bed8b-47d3-46e9-8f56-66651ce3af51 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-80b0f549-c07e-4d65-abbd-e5326e2b5518 req-632bed8b-47d3-46e9-8f56-66651ce3af51 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] No waiting events found dispatching network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:21:39 user nova-compute[74638]: WARNING nova.compute.manager [req-80b0f549-c07e-4d65-abbd-e5326e2b5518 req-632bed8b-47d3-46e9-8f56-66651ce3af51 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received unexpected event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 for instance with vm_state building and task_state spawning.
Nov 08 20:21:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-b05d21ca-f808-4e5f-a585-ac9d83fcf449 req-742fe447-0019-4fda-8212-f48a75d44437 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b05d21ca-f808-4e5f-a585-ac9d83fcf449 req-742fe447-0019-4fda-8212-f48a75d44437 service nova] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b05d21ca-f808-4e5f-a585-ac9d83fcf449 req-742fe447-0019-4fda-8212-f48a75d44437 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b05d21ca-f808-4e5f-a585-ac9d83fcf449 req-742fe447-0019-4fda-8212-f48a75d44437 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-b05d21ca-f808-4e5f-a585-ac9d83fcf449 req-742fe447-0019-4fda-8212-f48a75d44437 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] No waiting events found dispatching network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:21:41 user nova-compute[74638]: WARNING nova.compute.manager [req-b05d21ca-f808-4e5f-a585-ac9d83fcf449 req-742fe447-0019-4fda-8212-f48a75d44437 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received unexpected event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 for instance with vm_state building and task_state spawning.
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:21:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Instance spawned successfully.
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:21:41 user nova-compute[74638]: INFO nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Took 6.63 seconds to spawn the instance on the hypervisor.
Nov 08 20:21:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:21:41 user nova-compute[74638]: INFO nova.compute.manager [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Took 7.59 seconds to build instance.
Nov 08 20:21:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59446322-8ed2-474d-947e-52c171475da8 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.712s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:21:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:57 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:21:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:21:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:21:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:22:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:22:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:22:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:22:02 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:22:03 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating instance_info_cache with network_info: [{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:22:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:22:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:22:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:22:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:05 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:22:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:06 user nova-compute[74638]: DEBUG nova.compute.manager [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:22:06 user nova-compute[74638]: INFO nova.compute.manager [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] instance snapshotting
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:07 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Beginning live snapshot process
Nov 08 20:22:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json -f qcow2 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json -f qcow2" returned: 0 in 0.239s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json -f qcow2 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1pwyptwq/c73bcb664feb440c987b4ea51ea80cb7.delta 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1pwyptwq/c73bcb664feb440c987b4ea51ea80cb7.delta 1073741824" returned: 0 in 0.056s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:08 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.390s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] COPY block job progress, current cursor: 17760256 final cursor: 75497472 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:09 user nova-compute[74638]: INFO nova.compute.manager [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Detaching volume 374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07
Nov 08 20:22:09 user nova-compute[74638]: INFO nova.virt.block_device [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Attempting to driver detach volume 374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 from mountpoint /dev/vdb
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Attempting to detach device vdb from instance 854bd78e-f3a1-4711-b880-56b0787eddf6 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:22:09 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:09 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:22:09 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:22:09 user nova-compute[74638]:   <serial>374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07</serial>
Nov 08 20:22:09 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:22:09 user nova-compute[74638]: </disk>
Nov 08 20:22:09 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:09 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Successfully detached device vdb from instance 854bd78e-f3a1-4711-b880-56b0787eddf6 from the persistent domain config.
Nov 08 20:22:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 854bd78e-f3a1-4711-b880-56b0787eddf6 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:22:09 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:09 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:22:09 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:22:09 user nova-compute[74638]:   <serial>374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07</serial>
Nov 08 20:22:09 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:22:09 user nova-compute[74638]: </disk>
Nov 08 20:22:09 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:22:09 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 20:22:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 854bd78e-f3a1-4711-b880-56b0787eddf6 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:22:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.453s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:10 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:22:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1pwyptwq/c73bcb664feb440c987b4ea51ea80cb7.delta /opt/stack/data/nova/instances/snapshots/tmp1pwyptwq/c73bcb664feb440c987b4ea51ea80cb7 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1pwyptwq/c73bcb664feb440c987b4ea51ea80cb7.delta /opt/stack/data/nova/instances/snapshots/tmp1pwyptwq/c73bcb664feb440c987b4ea51ea80cb7" returned: 0 in 0.724s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:11 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Snapshot extracted, beginning image upload
Nov 08 20:22:11 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:22:11 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7441MB free_disk=25.38866424560547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Applying migration context for instance 491aafd0-a4dd-4cb2-9584-e88c39367878 as it has an incoming, in-progress migration 11cf525b-1dd9-479e-ad68-9e2972eb2503. Migration status is finished {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 20:22:11 user nova-compute[74638]: INFO nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating resource usage from migration 11cf525b-1dd9-479e-ad68-9e2972eb2503
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5ec97bac-185e-4959-b763-6514faef8e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 854bd78e-f3a1-4711-b880-56b0787eddf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Migration 11cf525b-1dd9-479e-ad68-9e2972eb2503 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 491aafd0-a4dd-4cb2-9584-e88c39367878 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0f9039b6-fc00-4956-ae26-a17f2886396b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance ca4173af-55e0-4bfd-9c9f-6b6c59a18f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:22:11 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.144s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChqPHgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:22:12 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:22:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:22:12 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:22:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:22:12 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95377e8-98ad-4525-add8-624f5ecc6699]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:22:12 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b62a91-9d6d-4119-9286-76a8e4b7bd44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c] added
Nov 08 20:22:12 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7cc0bb-703e-4945-b5d2-d586ed989498]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bdc9cf-e68e-4e30-bdee-ef360be23f16]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RChqPHgU {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RChqPHgU" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a727b509-ae43-47af-bc2e-97d782d62cdf]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RChqPHgU'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0af922-1e6a-4593-b279-e0e98ab74b91]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7acefa-69b0-4f5b-aa4d-76d800e6b725]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda4632-c585-4919-b006-ed0da3c55599]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c, portal: 172.16.0.220,3260]
Nov 08 20:22:13 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c, portal: 172.16.0.220,3260] successful.
Nov 08 20:22:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54a6591-61df-4659-a463-e72734599716]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc77bd-a761-4492-b668-ec530209aca5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:13 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d50f8e-7dc1-4cf1-ae6f-14098339b53f]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChqPHgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Snapshot image upload complete
Nov 08 20:22:14 user nova-compute[74638]: INFO nova.compute.manager [None req-6ea3b551-958b-44e9-b190-ad7d32ceee6f tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Took 7.15 seconds to snapshot the instance on the hypervisor.
Nov 08 20:22:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:22:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23364383638666332', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:22:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364383638666332', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:22:14 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'flavor' on Instance uuid 0e529715-d390-4929-998f-5835de148256 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:22:14 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:14 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:22:14 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:22:14 user nova-compute[74638]:   <serial>f58b93bc-4ed3-4d92-af66-2c89c3d0926c</serial>
Nov 08 20:22:14 user nova-compute[74638]: </disk>
Nov 08 20:22:14 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:22:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:22:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:22:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No VIF found with MAC fa:16:3e:85:76:62, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:22:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c60ef537-6d40-4607-9da1-4970e2bb3ca1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.245s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "0e529715-d390-4929-998f-5835de148256" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:16 user nova-compute[74638]: INFO nova.compute.manager [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Detaching volume f58b93bc-4ed3-4d92-af66-2c89c3d0926c
Nov 08 20:22:16 user nova-compute[74638]: INFO nova.virt.block_device [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Attempting to driver detach volume f58b93bc-4ed3-4d92-af66-2c89c3d0926c from mountpoint /dev/vdb
Nov 08 20:22:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Attempting to detach device vdb from instance 0e529715-d390-4929-998f-5835de148256 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:22:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:22:16 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:16 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:22:16 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:22:16 user nova-compute[74638]:   <serial>f58b93bc-4ed3-4d92-af66-2c89c3d0926c</serial>
Nov 08 20:22:16 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:22:16 user nova-compute[74638]: </disk>
Nov 08 20:22:16 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:22:16 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Successfully detached device vdb from instance 0e529715-d390-4929-998f-5835de148256 from the persistent domain config.
Nov 08 20:22:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e529715-d390-4929-998f-5835de148256 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:22:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:22:16 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:16 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:22:16 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:22:16 user nova-compute[74638]:   <serial>f58b93bc-4ed3-4d92-af66-2c89c3d0926c</serial>
Nov 08 20:22:16 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:22:16 user nova-compute[74638]: </disk>
Nov 08 20:22:16 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:22:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e529715-d390-4929-998f-5835de148256 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:22:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 491aafd0-a4dd-4cb2-9584-e88c39367878 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 854bd78e-f3a1-4711-b880-56b0787eddf6 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 0e529715-d390-4929-998f-5835de148256 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 9c01852a-a4a9-48d9-a6f2-c74a31643837 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid ca4173af-55e0-4bfd-9c9f-6b6c59a18f49 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "9f955212-6cf6-4f51-944a-5a3482082fda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "0e529715-d390-4929-998f-5835de148256" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "9f955212-6cf6-4f51-944a-5a3482082fda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:22:30 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 854bd78e-f3a1-4711-b880-56b0787eddf6 is timed out.
Nov 08 20:22:30 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Successfully detached device vdb from instance 854bd78e-f3a1-4711-b880-56b0787eddf6 from the live domain config.
Nov 08 20:22:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbtJKHlE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:22:30 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea43588e-9811-4b41-80ee-5d9bd517e18d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:22:30 user nova-compute[74638]: No targets found.
Nov 08 20:22:30 user nova-compute[74638]: iSNS:
Nov 08 20:22:30 user nova-compute[74638]: No targets found.
Nov 08 20:22:30 user nova-compute[74638]: STATIC:
Nov 08 20:22:30 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b
Nov 08 20:22:30 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:30 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:30 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07
Nov 08 20:22:30 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:30 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:30 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c
Nov 08 20:22:30 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:30 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:30 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8
Nov 08 20:22:30 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:30 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:30 user nova-compute[74638]: FIRMWARE:
Nov 08 20:22:30 user nova-compute[74638]: No targets found.
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:22:30 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:22:30 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b57a7f-271e-4c80-9a8b-3a59a93f80aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfa2021-e8f0-4674-8755-31cb590c85af]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c18a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a1d5f-cab9-4ce6-8774-18a169f86acb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce58552a-1fa4-4ba7-b234-875e72267098]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[da972806-caa7-4d21-95a3-4db8e8ca2e3f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRsCamEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:22:30 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac1012-4cbb-4087-b5ff-356db05ed187]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae0e6e0-b385-41cb-9db5-c2daf92fcd45]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bba363d-1f50-41aa-84b7-1649573c1387]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07, portal: 172.16.0.220,3260]
Nov 08 20:22:30 user nova-compute[74638]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07, portal: 172.16.0.220,3260] successful.
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cf15ac-9974-4227-97a9-1b798cdbe76d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] <== disconnect_volume: return (320ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.162s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:22:30 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:22:30 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec69625a-5700-4ade-a4c7-8c58298c012a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:22:30 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0bd3fa-475c-434e-9b51-af605d0f4e9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281] added
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d94d4e-a4b7-4a06-8ed5-8be1195334f8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c4966f-f960-4e42-98d8-e4397e069a54]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRsCamEg {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRsCamEg" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[df10c029-0f0f-488c-abc4-86505071e8a9]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hRsCamEg'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b62bd7-03b3-4523-beb7-393907f9749a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f5a134-24cc-4708-83d8-63f6caf84bed]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ccc89a-e3a8-4a45-8923-9c5260eeddf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281, portal: 172.16.0.220,3260]
Nov 08 20:22:30 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281, portal: 172.16.0.220,3260] successful.
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdd6f95-8dfe-4be5-b7b9-2243c8b78e54]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[779006f1-7cb1-487e-a762-35f923d54f49]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:30 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:22:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[20362b8b-896c-4986-b678-c50ae6569309]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:22:31 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:22:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRsCamEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:22:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:22:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '26533616365653066', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:22:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533616365653066', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:22:31 user nova-compute[74638]: DEBUG nova.objects.instance [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:22:31 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:31 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:22:31 user nova-compute[74638]:   <target dev="vdc" bus="virtio"/>
Nov 08 20:22:31 user nova-compute[74638]:   <serial>9271585f-3819-43a9-97d2-24625a93a281</serial>
Nov 08 20:22:31 user nova-compute[74638]: </disk>
Nov 08 20:22:31 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:22:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:22:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:22:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:22:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:22:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] No VIF found with MAC fa:16:3e:1a:22:68, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:22:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7eb7da7d-7b57-4b06-a841-ce5c10a187aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.468s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.699s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-e53cfcb3-7ad5-489a-ae17-50f8e048e177 req-0a05fd8c-36f0-4401-b11f-d78a3ad7653c service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-changed-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-e53cfcb3-7ad5-489a-ae17-50f8e048e177 req-0a05fd8c-36f0-4401-b11f-d78a3ad7653c service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Refreshing instance network info cache due to event network-changed-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e53cfcb3-7ad5-489a-ae17-50f8e048e177 req-0a05fd8c-36f0-4401-b11f-d78a3ad7653c service nova] Acquiring lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e53cfcb3-7ad5-489a-ae17-50f8e048e177 req-0a05fd8c-36f0-4401-b11f-d78a3ad7653c service nova] Acquired lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG nova.network.neutron [req-e53cfcb3-7ad5-489a-ae17-50f8e048e177 req-0a05fd8c-36f0-4401-b11f-d78a3ad7653c service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Refreshing network info cache for port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG nova.network.neutron [req-e53cfcb3-7ad5-489a-ae17-50f8e048e177 req-0a05fd8c-36f0-4401-b11f-d78a3ad7653c service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updated VIF entry in instance network info cache for port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG nova.network.neutron [req-e53cfcb3-7ad5-489a-ae17-50f8e048e177 req-0a05fd8c-36f0-4401-b11f-d78a3ad7653c service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating instance_info_cache with network_info: [{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e53cfcb3-7ad5-489a-ae17-50f8e048e177 req-0a05fd8c-36f0-4401-b11f-d78a3ad7653c service nova] Releasing lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:33 user nova-compute[74638]: INFO nova.compute.manager [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Detaching volume 28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8
Nov 08 20:22:34 user nova-compute[74638]: INFO nova.virt.block_device [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Attempting to driver detach volume 28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 from mountpoint /dev/vdb
Nov 08 20:22:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Attempting to detach device vdb from instance 5ec97bac-185e-4959-b763-6514faef8e5d from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:22:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:22:34 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:34 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:22:34 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:22:34 user nova-compute[74638]:   <serial>28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8</serial>
Nov 08 20:22:34 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:22:34 user nova-compute[74638]: </disk>
Nov 08 20:22:34 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:22:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully detached device vdb from instance 5ec97bac-185e-4959-b763-6514faef8e5d from the persistent domain config.
Nov 08 20:22:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ec97bac-185e-4959-b763-6514faef8e5d from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:22:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:22:34 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:34 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:22:34 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:22:34 user nova-compute[74638]:   <serial>28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8</serial>
Nov 08 20:22:34 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:22:34 user nova-compute[74638]: </disk>
Nov 08 20:22:34 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:22:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:37 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e529715-d390-4929-998f-5835de148256 is timed out.
Nov 08 20:22:37 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Successfully detached device vdb from instance 0e529715-d390-4929-998f-5835de148256 from the live domain config.
Nov 08 20:22:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChqPHgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:22:37 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9f8688-8fef-46ba-ad26-07d2320c7324]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:22:37 user nova-compute[74638]: No targets found.
Nov 08 20:22:37 user nova-compute[74638]: iSNS:
Nov 08 20:22:37 user nova-compute[74638]: No targets found.
Nov 08 20:22:37 user nova-compute[74638]: STATIC:
Nov 08 20:22:37 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281
Nov 08 20:22:37 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:37 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:37 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b
Nov 08 20:22:37 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:37 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:37 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c
Nov 08 20:22:37 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:37 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:37 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8
Nov 08 20:22:37 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:37 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:37 user nova-compute[74638]: FIRMWARE:
Nov 08 20:22:37 user nova-compute[74638]: No targets found.
Nov 08 20:22:37 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:22:37 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:22:37 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3966f60-48cf-4c35-a3a0-2311dd804a24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[869537f8-dc74-4292-b742-648f5241700b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:37 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:37 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:37 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:22:37 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:37 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:37 user nova-compute[74638]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c (non-flash)
Nov 08 20:22:37 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:22:37 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c011d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c79b6-0619-4955-9b4a-4b13da978d59]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec725b4e-43ed-422a-9257-f2d3143dc252]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a1a6a-6df9-4bdf-866c-8f9585e12512]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[26960209-89b0-4c89-bb58-b98dd0d17d74]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07b5bb9-e2ee-4b42-86b0-d5d111c586b2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf91857-0198-4c3b-b516-266e60a86503]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c, portal: 172.16.0.220,3260]
Nov 08 20:22:37 user nova-compute[74638]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c, portal: 172.16.0.220,3260] successful.
Nov 08 20:22:37 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f58b93bc-4ed3-4d92-af66-2c89c3d0926c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8535b322-7786-46ed-93be-d40ce93fe5d8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] <== disconnect_volume: return (316ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:22:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:22:38 user nova-compute[74638]: DEBUG nova.objects.instance [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'flavor' on Instance uuid 0e529715-d390-4929-998f-5835de148256 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-538db419-f891-4ca9-a3ea-1a7c2a99efe1 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.834s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "0e529715-d390-4929-998f-5835de148256" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.675s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "0e529715-d390-4929-998f-5835de148256" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'flavor' on Instance uuid 854bd78e-f3a1-4711-b880-56b0787eddf6 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f19a536e-5900-49c4-95bb-6b278b7a36ae tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.766s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 29.579s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:39 user nova-compute[74638]: INFO nova.compute.manager [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Terminating instance
Nov 08 20:22:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-056483da-baa6-465c-befc-4a3f2c49b965 req-3ea1e5c1-f18d-440c-bc7f-7e01db7fc66c service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received event network-vif-unplugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-056483da-baa6-465c-befc-4a3f2c49b965 req-3ea1e5c1-f18d-440c-bc7f-7e01db7fc66c service nova] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-056483da-baa6-465c-befc-4a3f2c49b965 req-3ea1e5c1-f18d-440c-bc7f-7e01db7fc66c service nova] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-056483da-baa6-465c-befc-4a3f2c49b965 req-3ea1e5c1-f18d-440c-bc7f-7e01db7fc66c service nova] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-056483da-baa6-465c-befc-4a3f2c49b965 req-3ea1e5c1-f18d-440c-bc7f-7e01db7fc66c service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] No waiting events found dispatching network-vif-unplugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-056483da-baa6-465c-befc-4a3f2c49b965 req-3ea1e5c1-f18d-440c-bc7f-7e01db7fc66c service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received event network-vif-unplugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:22:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:40 user nova-compute[74638]: INFO nova.compute.manager [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Shelving
Nov 08 20:22:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Instance destroyed successfully.
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'resources' on Instance uuid 854bd78e-f3a1-4711-b880-56b0787eddf6 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-83666426',display_name='tempest-VolumesSnapshotTestJSON-instance-83666426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-83666426',id=23,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxnfxmWR7JsWnArFl6p64rxl6Mc65y/e6wo7gK8AMHUygLFUKVRg2UKyBDokPYtFaszCk67fRnpsYXaOtmSlRFFItDxoLZbTbNXxryinDqifp+SBx4+MlJ5+YoJoYZsLQ==',key_name='tempest-keypair-1914665983',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a945ba0f2d41aa9cd7ad8dfd3ea0a3',ramdisk_id='',reservation_id='r-81wikjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1022894138',owner_user_name='tempest-VolumesSnapshotTestJSON-1022894138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:18:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875fdd7768654b8e8c261749bbb1c78e',uuid=854bd78e-f3a1-4711-b880-56b0787eddf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converting VIF {"id": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "address": "fa:16:3e:aa:18:95", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c5fdc8-fa", "ovs_interfaceid": "84c5fdc8-faae-454a-9a74-a9ff4bd3136c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:18:95,bridge_name='br-int',has_traffic_filtering=True,id=84c5fdc8-faae-454a-9a74-a9ff4bd3136c,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5fdc8-fa') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_vif [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:18:95,bridge_name='br-int',has_traffic_filtering=True,id=84c5fdc8-faae-454a-9a74-a9ff4bd3136c,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5fdc8-fa') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c5fdc8-fa, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b35f2f8-7f54-4efc-8506-041fc9c07f47) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: INFO os_vif [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:18:95,bridge_name='br-int',has_traffic_filtering=True,id=84c5fdc8-faae-454a-9a74-a9ff4bd3136c,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c5fdc8-fa')
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbtJKHlE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:22:40 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e06d84d-c689-42ab-8c97-3bae4b3537c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:22:40 user nova-compute[74638]: No targets found.
Nov 08 20:22:40 user nova-compute[74638]: iSNS:
Nov 08 20:22:40 user nova-compute[74638]: No targets found.
Nov 08 20:22:40 user nova-compute[74638]: STATIC:
Nov 08 20:22:40 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281
Nov 08 20:22:40 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:40 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:40 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b
Nov 08 20:22:40 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:40 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:40 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8
Nov 08 20:22:40 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:40 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:40 user nova-compute[74638]: FIRMWARE:
Nov 08 20:22:40 user nova-compute[74638]: No targets found.
Nov 08 20:22:40 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:22:40 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:22:40 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:374bbd5d-4edb-4dea-a6f6-fd7ce2b4bd07', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d71e96-9ebe-4e42-8c90-3536ab521468]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec735ca-1f2f-4338-a24d-732515555f10]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:40 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:40 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:22:40 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:40 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:40 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:22:40 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c5cacb0>, {}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Disconnecting from: [] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] <== disconnect_volume: return (90ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:22:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Deleting instance files /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6_del
Nov 08 20:22:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Deletion of /opt/stack/data/nova/instances/854bd78e-f3a1-4711-b880-56b0787eddf6_del complete
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:40 user nova-compute[74638]: INFO nova.compute.manager [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.compute.manager [req-1763f33e-e58d-4915-af8f-c6b8c0c94fbc req-dfb7b1be-a55d-46fd-b4ca-cb9426e26910 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-unplugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1763f33e-e58d-4915-af8f-c6b8c0c94fbc req-dfb7b1be-a55d-46fd-b4ca-cb9426e26910 service nova] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1763f33e-e58d-4915-af8f-c6b8c0c94fbc req-dfb7b1be-a55d-46fd-b4ca-cb9426e26910 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1763f33e-e58d-4915-af8f-c6b8c0c94fbc req-dfb7b1be-a55d-46fd-b4ca-cb9426e26910 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.compute.manager [req-1763f33e-e58d-4915-af8f-c6b8c0c94fbc req-dfb7b1be-a55d-46fd-b4ca-cb9426e26910 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] No waiting events found dispatching network-vif-unplugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:22:40 user nova-compute[74638]: WARNING nova.compute.manager [req-1763f33e-e58d-4915-af8f-c6b8c0c94fbc req-dfb7b1be-a55d-46fd-b4ca-cb9426e26910 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received unexpected event network-vif-unplugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e for instance with vm_state active and task_state shelving.
Nov 08 20:22:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance destroyed successfully.
Nov 08 20:22:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Beginning cold snapshot process
Nov 08 20:22:40 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:22:40 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk /opt/stack/data/nova/instances/snapshots/tmpgg001f0y/e554730603314082bbdae4ff52ee741d {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-d606fa2f-d5a6-48fa-a0cf-d83f1c6ced0a req-cbd0dd61-7fd3-49cd-9136-adfcd42c315e service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received event network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:22:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d606fa2f-d5a6-48fa-a0cf-d83f1c6ced0a req-cbd0dd61-7fd3-49cd-9136-adfcd42c315e service nova] Acquiring lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d606fa2f-d5a6-48fa-a0cf-d83f1c6ced0a req-cbd0dd61-7fd3-49cd-9136-adfcd42c315e service nova] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d606fa2f-d5a6-48fa-a0cf-d83f1c6ced0a req-cbd0dd61-7fd3-49cd-9136-adfcd42c315e service nova] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-d606fa2f-d5a6-48fa-a0cf-d83f1c6ced0a req-cbd0dd61-7fd3-49cd-9136-adfcd42c315e service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] No waiting events found dispatching network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:22:41 user nova-compute[74638]: WARNING nova.compute.manager [req-d606fa2f-d5a6-48fa-a0cf-d83f1c6ced0a req-cbd0dd61-7fd3-49cd-9136-adfcd42c315e service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received unexpected event network-vif-plugged-84c5fdc8-faae-454a-9a74-a9ff4bd3136c for instance with vm_state active and task_state deleting.
Nov 08 20:22:41 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:22:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfebc46d-af08-47f8-864a-a480716a3f97 req-cae87822-b9f7-41c5-a7aa-3583346b9ae6 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Received event network-vif-deleted-84c5fdc8-faae-454a-9a74-a9ff4bd3136c {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:22:41 user nova-compute[74638]: INFO nova.compute.manager [req-dfebc46d-af08-47f8-864a-a480716a3f97 req-cae87822-b9f7-41c5-a7aa-3583346b9ae6 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Neutron deleted interface 84c5fdc8-faae-454a-9a74-a9ff4bd3136c; detaching it from the instance and deleting it from the info cache
Nov 08 20:22:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-dfebc46d-af08-47f8-864a-a480716a3f97 req-cae87822-b9f7-41c5-a7aa-3583346b9ae6 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:22:41 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Took 1.34 seconds to deallocate network for instance.
Nov 08 20:22:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfebc46d-af08-47f8-864a-a480716a3f97 req-cae87822-b9f7-41c5-a7aa-3583346b9ae6 service nova] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Detach interface failed, port_id=84c5fdc8-faae-454a-9a74-a9ff4bd3136c, reason: Instance 854bd78e-f3a1-4711-b880-56b0787eddf6 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:22:41 user nova-compute[74638]: WARNING nova.volume.cinder [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Attachment 9c6416a4-a838-4681-93ca-d1d5cef2a2e1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9c6416a4-a838-4681-93ca-d1d5cef2a2e1. (HTTP 404) (Request-ID: req-1d436fa4-0b7b-43d5-ab25-335af0214c87)
Nov 08 20:22:41 user nova-compute[74638]: INFO nova.compute.manager [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 20:22:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk /opt/stack/data/nova/instances/snapshots/tmpgg001f0y/e554730603314082bbdae4ff52ee741d" returned: 0 in 0.931s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Snapshot extracted, beginning image upload
Nov 08 20:22:42 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:22:42 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:22:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:42 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Deleted allocations for instance 854bd78e-f3a1-4711-b880-56b0787eddf6
Nov 08 20:22:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c8d59840-1cec-405f-867a-d63861dd3007 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.062s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.366s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:42 user nova-compute[74638]: INFO nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 854bd78e-f3a1-4711-b880-56b0787eddf6] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 08 20:22:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "854bd78e-f3a1-4711-b880-56b0787eddf6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-c29d69de-8b7e-459c-8614-8f09e287155b req-f4b513a2-ef61-4df1-bb6b-7e05cef85ee3 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:22:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c29d69de-8b7e-459c-8614-8f09e287155b req-f4b513a2-ef61-4df1-bb6b-7e05cef85ee3 service nova] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c29d69de-8b7e-459c-8614-8f09e287155b req-f4b513a2-ef61-4df1-bb6b-7e05cef85ee3 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c29d69de-8b7e-459c-8614-8f09e287155b req-f4b513a2-ef61-4df1-bb6b-7e05cef85ee3 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-c29d69de-8b7e-459c-8614-8f09e287155b req-f4b513a2-ef61-4df1-bb6b-7e05cef85ee3 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] No waiting events found dispatching network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:22:42 user nova-compute[74638]: WARNING nova.compute.manager [req-c29d69de-8b7e-459c-8614-8f09e287155b req-f4b513a2-ef61-4df1-bb6b-7e05cef85ee3 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received unexpected event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 20:22:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Snapshot image upload complete
Nov 08 20:22:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:22:44 user nova-compute[74638]: INFO nova.compute.manager [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Shelve offloading
Nov 08 20:22:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance destroyed successfully.
Nov 08 20:22:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:22:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:22:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquired lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:22:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:22:44 user nova-compute[74638]: DEBUG nova.network.neutron [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating instance_info_cache with network_info: [{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:22:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Releasing lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance destroyed successfully.
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'resources' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1143454668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1143454668',id=26,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxzJ3KE50iQM0jwOCqCh4KQ/vzvRLl3tq/Ll6Ya0m8Ck/8f7/E3zGEiJKYPkSMgfZEV3PMQ7ob8StvEtDmGIaaKNNWNtdYc7UPFX2IyOl8478nhJBji0kZciyJQhhiUJg==',key_name='tempest-keypair-1222414860',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-15l2jril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member',shelved_at='2023-11-08T20:22:44.455130',shelved_host='user',shelved_image_id='8dd3e970-a395-4201-b210-6983a40fb63b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:22:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=0f9039b6-fc00-4956-ae26-a17f2886396b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG os_vif [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0355f8aa-41, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fec9e5bc-89ba-4dde-a5a4-89fbf26aee8c) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:22:45 user nova-compute[74638]: INFO os_vif [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41')
Nov 08 20:22:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Deleting instance files /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b_del
Nov 08 20:22:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Deletion of /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b_del complete
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-3e96b06c-ff6a-4386-a5a0-9a5603287bec req-c1bd18eb-66e9-404f-b685-b7a09314d134 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-changed-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-3e96b06c-ff6a-4386-a5a0-9a5603287bec req-c1bd18eb-66e9-404f-b685-b7a09314d134 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Refreshing instance network info cache due to event network-changed-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3e96b06c-ff6a-4386-a5a0-9a5603287bec req-c1bd18eb-66e9-404f-b685-b7a09314d134 service nova] Acquiring lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3e96b06c-ff6a-4386-a5a0-9a5603287bec req-c1bd18eb-66e9-404f-b685-b7a09314d134 service nova] Acquired lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-3e96b06c-ff6a-4386-a5a0-9a5603287bec req-c1bd18eb-66e9-404f-b685-b7a09314d134 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Refreshing network info cache for port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:22:45 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Deleted allocations for instance 0f9039b6-fc00-4956-ae26-a17f2886396b
Nov 08 20:22:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:45 user nova-compute[74638]: DEBUG nova.objects.base [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<0f9039b6-fc00-4956-ae26-a17f2886396b> lazy-loaded attributes: resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:22:46 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:22:46 user nova-compute[74638]: DEBUG nova.network.neutron [req-3e96b06c-ff6a-4386-a5a0-9a5603287bec req-c1bd18eb-66e9-404f-b685-b7a09314d134 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updated VIF entry in instance network info cache for port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:22:46 user nova-compute[74638]: DEBUG nova.network.neutron [req-3e96b06c-ff6a-4386-a5a0-9a5603287bec req-c1bd18eb-66e9-404f-b685-b7a09314d134 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating instance_info_cache with network_info: [{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0355f8aa-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:22:46 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:22:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3e96b06c-ff6a-4386-a5a0-9a5603287bec req-c1bd18eb-66e9-404f-b685-b7a09314d134 service nova] Releasing lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:22:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6bbdf75b-a4e3-40aa-94c9-8d932404d888 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.161s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Going to confirm migration 1 {{(pid=74638) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquired lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG nova.objects.instance [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'info_cache' on Instance uuid 491aafd0-a4dd-4cb2-9584-e88c39367878 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating instance_info_cache with network_info: [{"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Releasing lock "refresh_cache-491aafd0-a4dd-4cb2-9584-e88c39367878" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG nova.objects.instance [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'migration_context' on Instance uuid 491aafd0-a4dd-4cb2-9584-e88c39367878 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG nova.objects.base [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Object Instance<491aafd0-a4dd-4cb2-9584-e88c39367878> lazy-loaded attributes: info_cache,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:52 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:22:52 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:22:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.351s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:52 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Deleted allocation for migration 11cf525b-1dd9-479e-ad68-9e2972eb2503
Nov 08 20:22:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-672930b9-41fa-41ec-9319-882756e2e12e tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.250s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5ec97bac-185e-4959-b763-6514faef8e5d is timed out.
Nov 08 20:22:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully detached device vdb from instance 5ec97bac-185e-4959-b763-6514faef8e5d from the live domain config.
Nov 08 20:22:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYnSxbHf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:22:54 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c7574b-46bf-40fb-95b0-d09954d7a95e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:22:54 user nova-compute[74638]: No targets found.
Nov 08 20:22:54 user nova-compute[74638]: iSNS:
Nov 08 20:22:54 user nova-compute[74638]: No targets found.
Nov 08 20:22:54 user nova-compute[74638]: STATIC:
Nov 08 20:22:54 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281
Nov 08 20:22:54 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:54 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:54 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b
Nov 08 20:22:54 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:54 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:54 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8
Nov 08 20:22:54 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:22:54 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:22:54 user nova-compute[74638]: FIRMWARE:
Nov 08 20:22:54 user nova-compute[74638]: No targets found.
Nov 08 20:22:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:22:54 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:22:54 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[778cd042-41f3-4e32-b1a5-e72ce40b308e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03004af-b8ed-46a1-974d-79d95f52382d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:54 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:54 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:22:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:22:54 user nova-compute[74638]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 (non-flash)
Nov 08 20:22:54 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:22:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe555de3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2df25a-fc12-4651-9d22-063cc436a174]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[484da6e8-1f14-41c7-8cc1-86c574f0dff3]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bafd82-8a1f-4a07-ad07-d7a6c1b305b3]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4674c864-2af1-4b9a-a5a6-81724b7c4b89]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca538c5e-9089-46ec-86eb-07e3b8c06372]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d8d549-bb73-456a-b44c-0a367467a58c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8, portal: 172.16.0.220,3260]
Nov 08 20:22:54 user nova-compute[74638]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8, portal: 172.16.0.220,3260] successful.
Nov 08 20:22:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28ec1ecc-8cf0-4fb1-8213-18d98c2da2d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1d8ccd-5d70-4568-95d9-9a7dff7473ef]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== disconnect_volume: return (357ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:22:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:22:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:22:56 user nova-compute[74638]: DEBUG nova.objects.instance [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:22:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-77eae393-51f4-43f0-aeba-a76bf684a4aa tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.217s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:22:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:22:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:22:57 user nova-compute[74638]: INFO nova.compute.manager [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Detaching volume 9271585f-3819-43a9-97d2-24625a93a281
Nov 08 20:22:57 user nova-compute[74638]: INFO nova.virt.block_device [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Attempting to driver detach volume 9271585f-3819-43a9-97d2-24625a93a281 from mountpoint /dev/vdc
Nov 08 20:22:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Attempting to detach device vdc from instance 5ec97bac-185e-4959-b763-6514faef8e5d from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:22:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:22:57 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:57 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:22:57 user nova-compute[74638]:   <target dev="vdc" bus="virtio"/>
Nov 08 20:22:57 user nova-compute[74638]:   <serial>9271585f-3819-43a9-97d2-24625a93a281</serial>
Nov 08 20:22:57 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 20:22:57 user nova-compute[74638]: </disk>
Nov 08 20:22:57 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:22:57 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully detached device vdc from instance 5ec97bac-185e-4959-b763-6514faef8e5d from the persistent domain config.
Nov 08 20:22:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5ec97bac-185e-4959-b763-6514faef8e5d from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:22:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:22:57 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:22:57 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:22:57 user nova-compute[74638]:   <target dev="vdc" bus="virtio"/>
Nov 08 20:22:57 user nova-compute[74638]:   <serial>9271585f-3819-43a9-97d2-24625a93a281</serial>
Nov 08 20:22:57 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 20:22:57 user nova-compute[74638]: </disk>
Nov 08 20:22:57 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:22:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:22:58 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:02 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:23:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:23:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:23:02 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:23:03 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updating instance_info_cache with network_info: [{"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-5ec97bac-185e-4959-b763-6514faef8e5d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:23:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:23:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:23:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:23:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7773MB free_disk=25.343643188476562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5ec97bac-185e-4959-b763-6514faef8e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 491aafd0-a4dd-4cb2-9584-e88c39367878 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance ca4173af-55e0-4bfd-9c9f-6b6c59a18f49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:23:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:23:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:16 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:23:16 user nova-compute[74638]: INFO nova.compute.claims [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Claim successful on node user
Nov 08 20:23:16 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:23:16 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:23:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:23:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:23:16 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:23:16 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:23:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:23:16 user nova-compute[74638]: DEBUG nova.policy [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ab02946569c47ff9772753454afc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69c08c247c41cd842c3673cf9af390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:23:16 user nova-compute[74638]: INFO nova.virt.block_device [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Booting with blank volume at /dev/vda
Nov 08 20:23:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Successfully created port: 3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:23:17 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5ec97bac-185e-4959-b763-6514faef8e5d is timed out.
Nov 08 20:23:17 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully detached device vdc from instance 5ec97bac-185e-4959-b763-6514faef8e5d from the live domain config.
Nov 08 20:23:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRsCamEg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:23:17 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b0c0aa-4244-4588-a4d5-6391090f3a77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:23:17 user nova-compute[74638]: No targets found.
Nov 08 20:23:17 user nova-compute[74638]: iSNS:
Nov 08 20:23:17 user nova-compute[74638]: No targets found.
Nov 08 20:23:17 user nova-compute[74638]: STATIC:
Nov 08 20:23:17 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281
Nov 08 20:23:17 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:23:17 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:23:17 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b
Nov 08 20:23:17 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:23:17 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:23:17 user nova-compute[74638]: FIRMWARE:
Nov 08 20:23:17 user nova-compute[74638]: No targets found.
Nov 08 20:23:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:23:17 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:23:17 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbdb0e8-8dc6-432f-8240-455a71453045]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[634b5645-d6a6-4693-849b-48894ed854d0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:23:17 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:23:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:23:17 user nova-compute[74638]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 (non-flash)
Nov 08 20:23:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c2f32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d5151-0a22-4d76-a2e3-bd24156d78cc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Successfully updated port: 3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d7006-ae4d-4025-b866-b1e82a87eb97]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquired lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[352595c3-4137-4513-922f-4f5fc0f76032]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ccab979-48dc-41e0-be28-461e98bae9f3 req-cb9b0866-78da-42e7-8e2d-962a1a92af04 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-changed-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ccab979-48dc-41e0-be28-461e98bae9f3 req-cb9b0866-78da-42e7-8e2d-962a1a92af04 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Refreshing instance network info cache due to event network-changed-3ad67f50-983b-43e0-ada8-5da7b9d5ef28. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ccab979-48dc-41e0-be28-461e98bae9f3 req-cb9b0866-78da-42e7-8e2d-962a1a92af04 service nova] Acquiring lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c90ec25-15bb-4aa4-8554-45f89347136b]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9229197e-c164-487e-a87d-ba8902aa5e36]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d76812-f460-409c-bd02-5e250a1a2786]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281, portal: 172.16.0.220,3260]
Nov 08 20:23:17 user nova-compute[74638]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281, portal: 172.16.0.220,3260] successful.
Nov 08 20:23:17 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271585f-3819-43a9-97d2-24625a93a281 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[526730e5-e80a-4830-bf00-654b06ee7234]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] <== disconnect_volume: return (302ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:23:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating instance_info_cache with network_info: [{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Releasing lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance network_info: |[{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ccab979-48dc-41e0-be28-461e98bae9f3 req-cb9b0866-78da-42e7-8e2d-962a1a92af04 service nova] Acquired lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ccab979-48dc-41e0-be28-461e98bae9f3 req-cb9b0866-78da-42e7-8e2d-962a1a92af04 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Refreshing network info cache for port 3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ccab979-48dc-41e0-be28-461e98bae9f3 req-cb9b0866-78da-42e7-8e2d-962a1a92af04 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updated VIF entry in instance network info cache for port 3ad67f50-983b-43e0-ada8-5da7b9d5ef28. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ccab979-48dc-41e0-be28-461e98bae9f3 req-cb9b0866-78da-42e7-8e2d-962a1a92af04 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating instance_info_cache with network_info: [{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ccab979-48dc-41e0-be28-461e98bae9f3 req-cb9b0866-78da-42e7-8e2d-962a1a92af04 service nova] Releasing lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'flavor' on Instance uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:23:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c1edfa2-8d9f-4dd0-bff9-917c3ce3d05f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.887s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:19 user nova-compute[74638]: INFO nova.compute.manager [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Terminating instance
Nov 08 20:23:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-9536259c-7eda-4380-a31e-5c4a6fcb7df6 req-720e73d0-80ed-4595-a212-91ca9878b1ad service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received event network-vif-unplugged-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9536259c-7eda-4380-a31e-5c4a6fcb7df6 req-720e73d0-80ed-4595-a212-91ca9878b1ad service nova] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9536259c-7eda-4380-a31e-5c4a6fcb7df6 req-720e73d0-80ed-4595-a212-91ca9878b1ad service nova] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9536259c-7eda-4380-a31e-5c4a6fcb7df6 req-720e73d0-80ed-4595-a212-91ca9878b1ad service nova] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-9536259c-7eda-4380-a31e-5c4a6fcb7df6 req-720e73d0-80ed-4595-a212-91ca9878b1ad service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] No waiting events found dispatching network-vif-unplugged-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-9536259c-7eda-4380-a31e-5c4a6fcb7df6 req-720e73d0-80ed-4595-a212-91ca9878b1ad service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received event network-vif-unplugged-20297004-c8b7-4d79-865d-dd041c9178d2 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Instance destroyed successfully.
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.objects.instance [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lazy-loading 'resources' on Instance uuid 5ec97bac-185e-4959-b763-6514faef8e5d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1275336976',display_name='tempest-AttachVolumeTestJSON-server-1275336976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1275336976',id=22,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzVWacjKCXRQCU3Yw1AeIjIzDu26YvmMM1hPkvudwvEWb9WLuUTLntI59CD8+v5+qzHMsYorp0hetH7W21lnUtJZWBQKxpQHfiUlRjNeACm0VTvew3G/3sF6rnXBJkwHA==',key_name='tempest-keypair-88583300',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:18:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b6b297f1c394c5d84966b543d7a9cc6',ramdisk_id='',reservation_id='r-tm3ka2wk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1773867302',owner_user_name='tempest-AttachVolumeTestJSON-1773867302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b75bc3e9142b4bf6a314dc12b7a42bbe',uuid=5ec97bac-185e-4959-b763-6514faef8e5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converting VIF {"id": "20297004-c8b7-4d79-865d-dd041c9178d2", "address": "fa:16:3e:1a:22:68", "network": {"id": "9debfe89-8228-4913-9990-f4d023ed17fc", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1098728874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b6b297f1c394c5d84966b543d7a9cc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20297004-c8", "ovs_interfaceid": "20297004-c8b7-4d79-865d-dd041c9178d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:22:68,bridge_name='br-int',has_traffic_filtering=True,id=20297004-c8b7-4d79-865d-dd041c9178d2,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20297004-c8') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG os_vif [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:22:68,bridge_name='br-int',has_traffic_filtering=True,id=20297004-c8b7-4d79-865d-dd041c9178d2,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20297004-c8') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20297004-c8, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e981e08-500e-433b-9761-35caa86b324e) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:20 user nova-compute[74638]: INFO os_vif [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:22:68,bridge_name='br-int',has_traffic_filtering=True,id=20297004-c8b7-4d79-865d-dd041c9178d2,network=Network(9debfe89-8228-4913-9990-f4d023ed17fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20297004-c8')
Nov 08 20:23:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Deleting instance files /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d_del
Nov 08 20:23:20 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Deletion of /opt/stack/data/nova/instances/5ec97bac-185e-4959-b763-6514faef8e5d_del complete
Nov 08 20:23:20 user nova-compute[74638]: INFO nova.compute.manager [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 20:23:20 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:23:20 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:23:21 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:21 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Took 1.02 seconds to deallocate network for instance.
Nov 08 20:23:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-1fbc29df-a7ed-4e0a-bd8c-fe30e2b44a4b req-0dbdad79-6709-4df3-98b6-2a3fc7fa9de9 service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received event network-vif-deleted-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:22 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:23:22 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:23:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:22 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Deleted allocations for instance 5ec97bac-185e-4959-b763-6514faef8e5d
Nov 08 20:23:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-4934f3e3-b372-4adc-8af5-2e26e9ff25cf req-3c144a49-337d-4e48-a4d4-f78b064101af service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received event network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4934f3e3-b372-4adc-8af5-2e26e9ff25cf req-3c144a49-337d-4e48-a4d4-f78b064101af service nova] Acquiring lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4934f3e3-b372-4adc-8af5-2e26e9ff25cf req-3c144a49-337d-4e48-a4d4-f78b064101af service nova] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4934f3e3-b372-4adc-8af5-2e26e9ff25cf req-3c144a49-337d-4e48-a4d4-f78b064101af service nova] Lock "5ec97bac-185e-4959-b763-6514faef8e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-4934f3e3-b372-4adc-8af5-2e26e9ff25cf req-3c144a49-337d-4e48-a4d4-f78b064101af service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] No waiting events found dispatching network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:22 user nova-compute[74638]: WARNING nova.compute.manager [req-4934f3e3-b372-4adc-8af5-2e26e9ff25cf req-3c144a49-337d-4e48-a4d4-f78b064101af service nova] [instance: 5ec97bac-185e-4959-b763-6514faef8e5d] Received unexpected event network-vif-plugged-20297004-c8b7-4d79-865d-dd041c9178d2 for instance with vm_state deleted and task_state None.
Nov 08 20:23:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-09e90110-7531-4c6c-930e-80b65507d44f tempest-AttachVolumeTestJSON-1773867302 tempest-AttachVolumeTestJSON-1773867302-project-member] Lock "5ec97bac-185e-4959-b763-6514faef8e5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:23 user nova-compute[74638]: INFO nova.compute.manager [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Terminating instance
Nov 08 20:23:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-28744c5f-c28a-43fc-ad04-a9d4709ea7be req-721ed3e0-adaf-4b01-af6a-d634399613d2 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-unplugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-28744c5f-c28a-43fc-ad04-a9d4709ea7be req-721ed3e0-adaf-4b01-af6a-d634399613d2 service nova] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-28744c5f-c28a-43fc-ad04-a9d4709ea7be req-721ed3e0-adaf-4b01-af6a-d634399613d2 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-28744c5f-c28a-43fc-ad04-a9d4709ea7be req-721ed3e0-adaf-4b01-af6a-d634399613d2 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-28744c5f-c28a-43fc-ad04-a9d4709ea7be req-721ed3e0-adaf-4b01-af6a-d634399613d2 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] No waiting events found dispatching network-vif-unplugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-28744c5f-c28a-43fc-ad04-a9d4709ea7be req-721ed3e0-adaf-4b01-af6a-d634399613d2 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-unplugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Instance destroyed successfully.
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.objects.instance [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lazy-loading 'resources' on Instance uuid ca4173af-55e0-4bfd-9c9f-6b6c59a18f49 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1782531075',display_name='tempest-VolumesNegativeTest-instance-1782531075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1782531075',id=27,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:21:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8922bc53038a407ca3fa2c5840075a68',ramdisk_id='',reservation_id='r-f5hn0qja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1354114148',owner_user_name='tempest-VolumesNegativeTest-1354114148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:21:42Z,user_data=None,user_id='8f4f864db53145f9b90149220d5b006b',uuid=ca4173af-55e0-4bfd-9c9f-6b6c59a18f49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Converting VIF {"id": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "address": "fa:16:3e:3f:55:d3", "network": {"id": "9442ac35-8c8a-4e97-a9d4-d2e4f87144b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6d04b04bab24403bbb2bd99d8dea0ded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603a1b6a-57", "ovs_interfaceid": "603a1b6a-576a-4c7d-84f6-92c46f640a53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:d3,bridge_name='br-int',has_traffic_filtering=True,id=603a1b6a-576a-4c7d-84f6-92c46f640a53,network=Network(9442ac35-8c8a-4e97-a9d4-d2e4f87144b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603a1b6a-57') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG os_vif [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:d3,bridge_name='br-int',has_traffic_filtering=True,id=603a1b6a-576a-4c7d-84f6-92c46f640a53,network=Network(9442ac35-8c8a-4e97-a9d4-d2e4f87144b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603a1b6a-57') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap603a1b6a-57, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6a256f8-bcb0-4710-b44d-c8cbd4d7f238) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:24 user nova-compute[74638]: INFO os_vif [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:55:d3,bridge_name='br-int',has_traffic_filtering=True,id=603a1b6a-576a-4c7d-84f6-92c46f640a53,network=Network(9442ac35-8c8a-4e97-a9d4-d2e4f87144b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603a1b6a-57')
Nov 08 20:23:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Deleting instance files /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49_del
Nov 08 20:23:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Deletion of /opt/stack/data/nova/instances/ca4173af-55e0-4bfd-9c9f-6b6c59a18f49_del complete
Nov 08 20:23:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:24 user nova-compute[74638]: INFO nova.compute.manager [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 08 20:23:24 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:23:24 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:25 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Took 0.66 seconds to deallocate network for instance.
Nov 08 20:23:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-65e59594-9df1-48fd-8129-ce41912aedc1 req-60655eb1-811d-48be-8be9-56d3563994d2 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-deleted-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:25 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Deleted allocations for instance ca4173af-55e0-4bfd-9c9f-6b6c59a18f49
Nov 08 20:23:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d0767aa1-e7d0-412c-ba74-401433fe44d7 tempest-VolumesNegativeTest-1354114148 tempest-VolumesNegativeTest-1354114148-project-member] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:23:25 user nova-compute[74638]: INFO nova.compute.manager [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] instance snapshotting
Nov 08 20:23:26 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Beginning live snapshot process
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json -f qcow2 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] No waiting events found dispatching network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:26 user nova-compute[74638]: WARNING nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received unexpected event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 for instance with vm_state deleted and task_state None.
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] No waiting events found dispatching network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:26 user nova-compute[74638]: WARNING nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received unexpected event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 for instance with vm_state deleted and task_state None.
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] No waiting events found dispatching network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:26 user nova-compute[74638]: WARNING nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received unexpected event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 for instance with vm_state deleted and task_state None.
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-unplugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] No waiting events found dispatching network-vif-unplugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:26 user nova-compute[74638]: WARNING nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received unexpected event network-vif-unplugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 for instance with vm_state deleted and task_state None.
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Acquiring lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] Lock "ca4173af-55e0-4bfd-9c9f-6b6c59a18f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] No waiting events found dispatching network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:26 user nova-compute[74638]: WARNING nova.compute.manager [req-8aded9df-ccb7-4316-960d-2cccf9d9ad74 req-fc4fc1a1-04d8-41d8-b4b1-8984409abb80 service nova] [instance: ca4173af-55e0-4bfd-9c9f-6b6c59a18f49] Received unexpected event network-vif-plugged-603a1b6a-576a-4c7d-84f6-92c46f640a53 for instance with vm_state deleted and task_state None.
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json -f qcow2 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw2od11rz/2f9b497891624026980d82c601eb0ea1.delta 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw2od11rz/2f9b497891624026980d82c601eb0ea1.delta 1073741824" returned: 0 in 0.050s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:26 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 20:23:27 user nova-compute[74638]: DEBUG os_brick.utils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a625bb-9514-4c7f-b9cb-6956c068d549]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46c7fb-a147-4c6d-870b-0843cbf3bad8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5434b4ac-9570-45ad-9bd8-262979f48d15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4054d0b7-a50f-4112-94ff-a9d6223ced96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:23:27 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:23:27 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b59113-b87e-4460-897a-aa96079a6bb9]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG os_brick.utils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating existing volume attachment record: 1c5cc27a-0875-41b0-b43f-cda8ee857e18 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:23:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:23:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:23:28 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 20:23:28 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:23:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw2od11rz/2f9b497891624026980d82c601eb0ea1.delta /opt/stack/data/nova/instances/snapshots/tmpw2od11rz/2f9b497891624026980d82c601eb0ea1 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw2od11rz/2f9b497891624026980d82c601eb0ea1.delta /opt/stack/data/nova/instances/snapshots/tmpw2od11rz/2f9b497891624026980d82c601eb0ea1" returned: 0 in 0.356s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:28 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Snapshot extracted, beginning image upload
Nov 08 20:23:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:31 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Snapshot image upload complete
Nov 08 20:23:31 user nova-compute[74638]: INFO nova.compute.manager [None req-fe2cb713-59ba-4bbe-83c7-9d2cc88e615e tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Took 5.19 seconds to snapshot the instance on the hypervisor.
Nov 08 20:23:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:23:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:23:33 user nova-compute[74638]: INFO nova.compute.claims [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Claim successful on node user
Nov 08 20:23:33 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:23:33 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:23:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:23:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:23:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG nova.policy [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b93d3cfa1354826ab6ff1efbe49f46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1466c6af77ed4c838f917c826e4c3594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:23:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Creating image(s)
Nov 08 20:23:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "/opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "/opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "/opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "769addcaff4416d80d8d18286d408525805b0afe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "769addcaff4416d80d8d18286d408525805b0afe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Successfully created port: 1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe.part --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG nova.virt.images [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] 6b69ce39-0fee-4a43-814d-b0b622c87432 was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:23:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe.part /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe.part /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe.converted" returned: 0 in 0.469s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:23:36 user nova-compute[74638]: INFO nova.compute.claims [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Claim successful on node user
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "769addcaff4416d80d8d18286d408525805b0afe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.284s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Successfully updated port: 1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquired lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "769addcaff4416d80d8d18286d408525805b0afe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "769addcaff4416d80d8d18286d408525805b0afe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-fa2c38cd-fd21-4b1e-a95f-b1406b207386 req-9362c067-5c3a-4a9e-a827-18808e27ca9a service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received event network-changed-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-fa2c38cd-fd21-4b1e-a95f-b1406b207386 req-9362c067-5c3a-4a9e-a827-18808e27ca9a service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Refreshing instance network info cache due to event network-changed-1840d14e-f577-43cc-97e7-ce187bf8fcdf. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fa2c38cd-fd21-4b1e-a95f-b1406b207386 req-9362c067-5c3a-4a9e-a827-18808e27ca9a service nova] Acquiring lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:23:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe --force-share --output=json" returned: 0 in 0.212s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe,backing_fmt=raw /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe,backing_fmt=raw /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk 1073741824" returned: 0 in 0.051s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "769addcaff4416d80d8d18286d408525805b0afe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.neutron [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:23:37 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.policy [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '444c578cebff4167825165a737b5bb85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f133d71d494371b87181e746074d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Ensure instance console log exists: /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updating instance_info_cache with network_info: [{"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Releasing lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Instance network_info: |[{"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fa2c38cd-fd21-4b1e-a95f-b1406b207386 req-9362c067-5c3a-4a9e-a827-18808e27ca9a service nova] Acquired lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.neutron [req-fa2c38cd-fd21-4b1e-a95f-b1406b207386 req-9362c067-5c3a-4a9e-a827-18808e27ca9a service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Refreshing network info cache for port 1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Start _get_guest_xml network_info=[{"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='669994dc87973556ecd048ed48d6644b',container_format='bare',created_at=2023-11-08T20:23:26Z,direct_url=<?>,disk_format='qcow2',id=6b69ce39-0fee-4a43-814d-b0b622c87432,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1698306865',owner='1466c6af77ed4c838f917c826e4c3594',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T20:23:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '6b69ce39-0fee-4a43-814d-b0b622c87432'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:23:37 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Creating image(s)
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:37 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:23:37 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='669994dc87973556ecd048ed48d6644b',container_format='bare',created_at=2023-11-08T20:23:26Z,direct_url=<?>,disk_format='qcow2',id=6b69ce39-0fee-4a43-814d-b0b622c87432,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1698306865',owner='1466c6af77ed4c838f917c826e4c3594',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T20:23:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-771820820',display_name='tempest-TestStampPattern-server-771820820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-771820820',id=29,image_ref='6b69ce39-0fee-4a43-814d-b0b622c87432',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxvPfR3m68mdARrbfav97jTy/o6OtKTjWJzrXNp0gr/QQk683HsyF983f34HQBJajTLCCF+GqbGWDF/11evWSydJuVmWuB9oczkR7bNKj4AYdUUQAWpsJK386HZ1lIOpA==',key_name='tempest-TestStampPattern-1081975694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1466c6af77ed4c838f917c826e4c3594',ramdisk_id='',reservation_id='r-0imms99s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0e529715-d390-4929-998f-5835de148256',image_min_disk='1',image_min_ram='0',image_owner_id='1466c6af77ed4c838f917c826e4c3594',image_owner_project_name='tempest-TestStampPattern-248486380',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-248486380-project-member',image_user_id='5b93d3cfa1354826ab6ff1efbe49f46d',network_allocated='True',owner_project_name='tempest-TestStampPattern-248486380',owner_user_name='tempest-TestStampPattern-248486380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:23:34Z,user_data=None,user_id='5b93d3cfa1354826ab6ff1efbe49f46d',uuid=536f5a6a-02f3-43bc-a66a-edf45a9f98c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converting VIF {"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e6:2c,bridge_name='br-int',has_traffic_filtering=True,id=1840d14e-f577-43cc-97e7-ce187bf8fcdf,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1840d14e-f5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.objects.instance [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'pci_devices' on Instance uuid 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:23:37 user nova-compute[74638]:   <uuid>536f5a6a-02f3-43bc-a66a-edf45a9f98c8</uuid>
Nov 08 20:23:37 user nova-compute[74638]:   <name>instance-0000001d</name>
Nov 08 20:23:37 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:23:37 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:23:37 user nova-compute[74638]:   <metadata>
Nov 08 20:23:37 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:23:37 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:23:37 user nova-compute[74638]:       <nova:name>tempest-TestStampPattern-server-771820820</nova:name>
Nov 08 20:23:37 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:23:37</nova:creationTime>
Nov 08 20:23:37 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:23:37 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:23:37 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:23:37 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:23:37 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:23:37 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:23:37 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:23:37 user nova-compute[74638]:       <nova:owner>
Nov 08 20:23:37 user nova-compute[74638]:         <nova:user uuid="5b93d3cfa1354826ab6ff1efbe49f46d">tempest-TestStampPattern-248486380-project-member</nova:user>
Nov 08 20:23:37 user nova-compute[74638]:         <nova:project uuid="1466c6af77ed4c838f917c826e4c3594">tempest-TestStampPattern-248486380</nova:project>
Nov 08 20:23:37 user nova-compute[74638]:       </nova:owner>
Nov 08 20:23:37 user nova-compute[74638]:       <nova:root type="image" uuid="6b69ce39-0fee-4a43-814d-b0b622c87432"/>
Nov 08 20:23:37 user nova-compute[74638]:       <nova:ports>
Nov 08 20:23:37 user nova-compute[74638]:         <nova:port uuid="1840d14e-f577-43cc-97e7-ce187bf8fcdf">
Nov 08 20:23:37 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 20:23:37 user nova-compute[74638]:         </nova:port>
Nov 08 20:23:37 user nova-compute[74638]:       </nova:ports>
Nov 08 20:23:37 user nova-compute[74638]:     </nova:instance>
Nov 08 20:23:37 user nova-compute[74638]:   </metadata>
Nov 08 20:23:37 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:23:37 user nova-compute[74638]:     <system>
Nov 08 20:23:37 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:23:37 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:23:37 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:23:37 user nova-compute[74638]:       <entry name="serial">536f5a6a-02f3-43bc-a66a-edf45a9f98c8</entry>
Nov 08 20:23:37 user nova-compute[74638]:       <entry name="uuid">536f5a6a-02f3-43bc-a66a-edf45a9f98c8</entry>
Nov 08 20:23:37 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:23:37 user nova-compute[74638]:     </system>
Nov 08 20:23:37 user nova-compute[74638]:   </sysinfo>
Nov 08 20:23:37 user nova-compute[74638]:   <os>
Nov 08 20:23:37 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:23:37 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:23:37 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:23:37 user nova-compute[74638]:   </os>
Nov 08 20:23:37 user nova-compute[74638]:   <features>
Nov 08 20:23:37 user nova-compute[74638]:     <acpi/>
Nov 08 20:23:37 user nova-compute[74638]:     <apic/>
Nov 08 20:23:37 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:23:37 user nova-compute[74638]:   </features>
Nov 08 20:23:37 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:23:37 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:23:37 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:23:37 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:23:37 user nova-compute[74638]:   </clock>
Nov 08 20:23:37 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:23:37 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:23:37 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:23:37 user nova-compute[74638]:   </cpu>
Nov 08 20:23:37 user nova-compute[74638]:   <devices>
Nov 08 20:23:37 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:23:37 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:23:37 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk"/>
Nov 08 20:23:37 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:23:37 user nova-compute[74638]:     </disk>
Nov 08 20:23:37 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:23:37 user nova-compute[74638]:       <mac address="fa:16:3e:e3:e6:2c"/>
Nov 08 20:23:37 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:23:37 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:23:37 user nova-compute[74638]:       <target dev="tap1840d14e-f5"/>
Nov 08 20:23:37 user nova-compute[74638]:     </interface>
Nov 08 20:23:37 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:23:37 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/console.log" append="off"/>
Nov 08 20:23:37 user nova-compute[74638]:     </serial>
Nov 08 20:23:37 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:23:37 user nova-compute[74638]:     <video>
Nov 08 20:23:37 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:23:37 user nova-compute[74638]:     </video>
Nov 08 20:23:37 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:23:37 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:23:37 user nova-compute[74638]:     </rng>
Nov 08 20:23:37 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:23:37 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:23:37 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:23:37 user nova-compute[74638]:     </memballoon>
Nov 08 20:23:37 user nova-compute[74638]:   </devices>
Nov 08 20:23:37 user nova-compute[74638]: </domain>
Nov 08 20:23:37 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-771820820',display_name='tempest-TestStampPattern-server-771820820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-771820820',id=29,image_ref='6b69ce39-0fee-4a43-814d-b0b622c87432',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxvPfR3m68mdARrbfav97jTy/o6OtKTjWJzrXNp0gr/QQk683HsyF983f34HQBJajTLCCF+GqbGWDF/11evWSydJuVmWuB9oczkR7bNKj4AYdUUQAWpsJK386HZ1lIOpA==',key_name='tempest-TestStampPattern-1081975694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1466c6af77ed4c838f917c826e4c3594',ramdisk_id='',reservation_id='r-0imms99s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0e529715-d390-4929-998f-5835de148256',image_min_disk='1',image_min_ram='0',image_owner_id='1466c6af77ed4c838f917c826e4c3594',image_owner_project_name='tempest-TestStampPattern-248486380',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-248486380-project-member',image_user_id='5b93d3cfa1354826ab6ff1efbe49f46d',network_allocated='True',owner_project_name='tempest-TestStampPattern-248486380',owner_user_name='tempest-TestStampPattern-248486380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:23:34Z,user_data=None,user_id='5b93d3cfa1354826ab6ff1efbe49f46d',uuid=536f5a6a-02f3-43bc-a66a-edf45a9f98c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converting VIF {"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e6:2c,bridge_name='br-int',has_traffic_filtering=True,id=1840d14e-f577-43cc-97e7-ce187bf8fcdf,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1840d14e-f5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG os_vif [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e6:2c,bridge_name='br-int',has_traffic_filtering=True,id=1840d14e-f577-43cc-97e7-ce187bf8fcdf,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1840d14e-f5') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daa49411-d241-5fcc-911e-800e8fdc3759', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1840d14e-f5, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1840d14e-f5, col_values=(('qos', UUID('699f8454-c5d9-4049-b8a5-be4ff4b2225b')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1840d14e-f5, col_values=(('external_ids', {'iface-id': '1840d14e-f577-43cc-97e7-ce187bf8fcdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:e6:2c', 'vm-uuid': '536f5a6a-02f3-43bc-a66a-edf45a9f98c8'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:37 user nova-compute[74638]: INFO os_vif [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:e6:2c,bridge_name='br-int',has_traffic_filtering=True,id=1840d14e-f577-43cc-97e7-ce187bf8fcdf,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1840d14e-f5')
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No VIF found with MAC fa:16:3e:e3:e6:2c, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk 1073741824" returned: 0 in 0.056s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.neutron [req-fa2c38cd-fd21-4b1e-a95f-b1406b207386 req-9362c067-5c3a-4a9e-a827-18808e27ca9a service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updated VIF entry in instance network info cache for port 1840d14e-f577-43cc-97e7-ce187bf8fcdf. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.network.neutron [req-fa2c38cd-fd21-4b1e-a95f-b1406b207386 req-9362c067-5c3a-4a9e-a827-18808e27ca9a service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updating instance_info_cache with network_info: [{"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fa2c38cd-fd21-4b1e-a95f-b1406b207386 req-9362c067-5c3a-4a9e-a827-18808e27ca9a service nova] Releasing lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:23:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG nova.network.neutron [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Successfully created port: 361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Cannot resize image /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Ensure instance console log exists: /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-2569d167-fb2f-4151-a018-9abec660319c req-7eb655cf-ee63-44bd-8e45-e3cec87a466c service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received event network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2569d167-fb2f-4151-a018-9abec660319c req-7eb655cf-ee63-44bd-8e45-e3cec87a466c service nova] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2569d167-fb2f-4151-a018-9abec660319c req-7eb655cf-ee63-44bd-8e45-e3cec87a466c service nova] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2569d167-fb2f-4151-a018-9abec660319c req-7eb655cf-ee63-44bd-8e45-e3cec87a466c service nova] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-2569d167-fb2f-4151-a018-9abec660319c req-7eb655cf-ee63-44bd-8e45-e3cec87a466c service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] No waiting events found dispatching network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:39 user nova-compute[74638]: WARNING nova.compute.manager [req-2569d167-fb2f-4151-a018-9abec660319c req-7eb655cf-ee63-44bd-8e45-e3cec87a466c service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received unexpected event network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf for instance with vm_state building and task_state spawning.
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Successfully updated port: 361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquired lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-1b352b0d-cf41-4934-8efd-d7d767a8feee req-d747c7cd-0018-402d-92e5-83be84c8c836 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-changed-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-1b352b0d-cf41-4934-8efd-d7d767a8feee req-d747c7cd-0018-402d-92e5-83be84c8c836 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Refreshing instance network info cache due to event network-changed-361e19ab-b526-4a96-9b9a-c7f671bf85be. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1b352b0d-cf41-4934-8efd-d7d767a8feee req-d747c7cd-0018-402d-92e5-83be84c8c836 service nova] Acquiring lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating instance_info_cache with network_info: [{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Releasing lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance network_info: |[{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1b352b0d-cf41-4934-8efd-d7d767a8feee req-d747c7cd-0018-402d-92e5-83be84c8c836 service nova] Acquired lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.neutron [req-1b352b0d-cf41-4934-8efd-d7d767a8feee req-d747c7cd-0018-402d-92e5-83be84c8c836 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Refreshing network info cache for port 361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Start _get_guest_xml network_info=[{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:23:39 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:23:39 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-78861426',display_name='tempest-ServerRescueNegativeTestJSON-server-78861426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-78861426',id=30,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWLIDNo3A6iC+Rs/V6O8UzxDvXMxbYKelsm2BtuSlovWsQ1nFYlMl3Valso2ECcejx6npl201NCuZCHLJp5xQPV4/sOHn1Cwz36eiJMeZeyW4eReIjVN0Q1qOVkVHXEkQ==',key_name='tempest-keypair-1883717809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-0ack4fjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='444c578cebff4167825165a737b5bb85',uuid=07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e7:8b,bridge_name='br-int',has_traffic_filtering=True,id=361e19ab-b526-4a96-9b9a-c7f671bf85be,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e19ab-b5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.objects.instance [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'pci_devices' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:23:39 user nova-compute[74638]:   <uuid>07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca</uuid>
Nov 08 20:23:39 user nova-compute[74638]:   <name>instance-0000001e</name>
Nov 08 20:23:39 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:23:39 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:23:39 user nova-compute[74638]:   <metadata>
Nov 08 20:23:39 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:23:39 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:23:39 user nova-compute[74638]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-78861426</nova:name>
Nov 08 20:23:39 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:23:39</nova:creationTime>
Nov 08 20:23:39 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:23:39 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:23:39 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:23:39 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:23:39 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:23:39 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:23:39 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:23:39 user nova-compute[74638]:       <nova:owner>
Nov 08 20:23:39 user nova-compute[74638]:         <nova:user uuid="444c578cebff4167825165a737b5bb85">tempest-ServerRescueNegativeTestJSON-1603324862-project-member</nova:user>
Nov 08 20:23:39 user nova-compute[74638]:         <nova:project uuid="e5f133d71d494371b87181e746074d70">tempest-ServerRescueNegativeTestJSON-1603324862</nova:project>
Nov 08 20:23:39 user nova-compute[74638]:       </nova:owner>
Nov 08 20:23:39 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:23:39 user nova-compute[74638]:       <nova:ports>
Nov 08 20:23:39 user nova-compute[74638]:         <nova:port uuid="361e19ab-b526-4a96-9b9a-c7f671bf85be">
Nov 08 20:23:39 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 20:23:39 user nova-compute[74638]:         </nova:port>
Nov 08 20:23:39 user nova-compute[74638]:       </nova:ports>
Nov 08 20:23:39 user nova-compute[74638]:     </nova:instance>
Nov 08 20:23:39 user nova-compute[74638]:   </metadata>
Nov 08 20:23:39 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:23:39 user nova-compute[74638]:     <system>
Nov 08 20:23:39 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:23:39 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:23:39 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:23:39 user nova-compute[74638]:       <entry name="serial">07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca</entry>
Nov 08 20:23:39 user nova-compute[74638]:       <entry name="uuid">07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca</entry>
Nov 08 20:23:39 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:23:39 user nova-compute[74638]:     </system>
Nov 08 20:23:39 user nova-compute[74638]:   </sysinfo>
Nov 08 20:23:39 user nova-compute[74638]:   <os>
Nov 08 20:23:39 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:23:39 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:23:39 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:23:39 user nova-compute[74638]:   </os>
Nov 08 20:23:39 user nova-compute[74638]:   <features>
Nov 08 20:23:39 user nova-compute[74638]:     <acpi/>
Nov 08 20:23:39 user nova-compute[74638]:     <apic/>
Nov 08 20:23:39 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:23:39 user nova-compute[74638]:   </features>
Nov 08 20:23:39 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:23:39 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:23:39 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:23:39 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:23:39 user nova-compute[74638]:   </clock>
Nov 08 20:23:39 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:23:39 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:23:39 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:23:39 user nova-compute[74638]:   </cpu>
Nov 08 20:23:39 user nova-compute[74638]:   <devices>
Nov 08 20:23:39 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:23:39 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:23:39 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk"/>
Nov 08 20:23:39 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:23:39 user nova-compute[74638]:     </disk>
Nov 08 20:23:39 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:23:39 user nova-compute[74638]:       <mac address="fa:16:3e:68:e7:8b"/>
Nov 08 20:23:39 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:23:39 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:23:39 user nova-compute[74638]:       <target dev="tap361e19ab-b5"/>
Nov 08 20:23:39 user nova-compute[74638]:     </interface>
Nov 08 20:23:39 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:23:39 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/console.log" append="off"/>
Nov 08 20:23:39 user nova-compute[74638]:     </serial>
Nov 08 20:23:39 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:23:39 user nova-compute[74638]:     <video>
Nov 08 20:23:39 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:23:39 user nova-compute[74638]:     </video>
Nov 08 20:23:39 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:23:39 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:23:39 user nova-compute[74638]:     </rng>
Nov 08 20:23:39 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:23:39 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:23:39 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:23:39 user nova-compute[74638]:     </memballoon>
Nov 08 20:23:39 user nova-compute[74638]:   </devices>
Nov 08 20:23:39 user nova-compute[74638]: </domain>
Nov 08 20:23:39 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-78861426',display_name='tempest-ServerRescueNegativeTestJSON-server-78861426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-78861426',id=30,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWLIDNo3A6iC+Rs/V6O8UzxDvXMxbYKelsm2BtuSlovWsQ1nFYlMl3Valso2ECcejx6npl201NCuZCHLJp5xQPV4/sOHn1Cwz36eiJMeZeyW4eReIjVN0Q1qOVkVHXEkQ==',key_name='tempest-keypair-1883717809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-0ack4fjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='444c578cebff4167825165a737b5bb85',uuid=07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:e7:8b,bridge_name='br-int',has_traffic_filtering=True,id=361e19ab-b526-4a96-9b9a-c7f671bf85be,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e19ab-b5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG os_vif [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e7:8b,bridge_name='br-int',has_traffic_filtering=True,id=361e19ab-b526-4a96-9b9a-c7f671bf85be,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e19ab-b5') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78bf0cf2-c99f-5035-be78-39b8c545155f', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap361e19ab-b5, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap361e19ab-b5, col_values=(('qos', UUID('ea456361-9f1d-4777-a212-018fbec4bfdb')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap361e19ab-b5, col_values=(('external_ids', {'iface-id': '361e19ab-b526-4a96-9b9a-c7f671bf85be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:e7:8b', 'vm-uuid': '07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:39 user nova-compute[74638]: INFO os_vif [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:e7:8b,bridge_name='br-int',has_traffic_filtering=True,id=361e19ab-b526-4a96-9b9a-c7f671bf85be,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e19ab-b5')
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:23:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No VIF found with MAC fa:16:3e:68:e7:8b, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:23:40 user nova-compute[74638]: DEBUG nova.network.neutron [req-1b352b0d-cf41-4934-8efd-d7d767a8feee req-d747c7cd-0018-402d-92e5-83be84c8c836 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updated VIF entry in instance network info cache for port 361e19ab-b526-4a96-9b9a-c7f671bf85be. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:23:40 user nova-compute[74638]: DEBUG nova.network.neutron [req-1b352b0d-cf41-4934-8efd-d7d767a8feee req-d747c7cd-0018-402d-92e5-83be84c8c836 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating instance_info_cache with network_info: [{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:23:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1b352b0d-cf41-4934-8efd-d7d767a8feee req-d747c7cd-0018-402d-92e5-83be84c8c836 service nova] Releasing lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-81050d71-efdd-40a1-84f4-351db243d2b9 req-914b6710-6268-4e91-adce-4682ef9ae97d service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received event network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-81050d71-efdd-40a1-84f4-351db243d2b9 req-914b6710-6268-4e91-adce-4682ef9ae97d service nova] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-81050d71-efdd-40a1-84f4-351db243d2b9 req-914b6710-6268-4e91-adce-4682ef9ae97d service nova] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-81050d71-efdd-40a1-84f4-351db243d2b9 req-914b6710-6268-4e91-adce-4682ef9ae97d service nova] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-81050d71-efdd-40a1-84f4-351db243d2b9 req-914b6710-6268-4e91-adce-4682ef9ae97d service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] No waiting events found dispatching network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:41 user nova-compute[74638]: WARNING nova.compute.manager [req-81050d71-efdd-40a1-84f4-351db243d2b9 req-914b6710-6268-4e91-adce-4682ef9ae97d service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received unexpected event network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf for instance with vm_state building and task_state spawning.
Nov 08 20:23:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:23:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Instance spawned successfully.
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:41 user nova-compute[74638]: INFO nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-3253d197-658d-4dcf-bb24-eb0743c45fd0 req-d566babd-495d-4544-84c7-4c6e73776da5 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3253d197-658d-4dcf-bb24-eb0743c45fd0 req-d566babd-495d-4544-84c7-4c6e73776da5 service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3253d197-658d-4dcf-bb24-eb0743c45fd0 req-d566babd-495d-4544-84c7-4c6e73776da5 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3253d197-658d-4dcf-bb24-eb0743c45fd0 req-d566babd-495d-4544-84c7-4c6e73776da5 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-3253d197-658d-4dcf-bb24-eb0743c45fd0 req-d566babd-495d-4544-84c7-4c6e73776da5 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:41 user nova-compute[74638]: WARNING nova.compute.manager [req-3253d197-658d-4dcf-bb24-eb0743c45fd0 req-d566babd-495d-4544-84c7-4c6e73776da5 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state building and task_state spawning.
Nov 08 20:23:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:41 user nova-compute[74638]: INFO nova.compute.manager [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Took 8.02 seconds to build instance.
Nov 08 20:23:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bbe9fa97-073b-4c46-a9f7-05b2a73682ba tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.150s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-9bf94372-bc39-4a5d-aea1-87697b6ed108 req-a01e3164-6301-4e42-8654-8d8bfee47cba service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9bf94372-bc39-4a5d-aea1-87697b6ed108 req-a01e3164-6301-4e42-8654-8d8bfee47cba service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9bf94372-bc39-4a5d-aea1-87697b6ed108 req-a01e3164-6301-4e42-8654-8d8bfee47cba service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9bf94372-bc39-4a5d-aea1-87697b6ed108 req-a01e3164-6301-4e42-8654-8d8bfee47cba service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-9bf94372-bc39-4a5d-aea1-87697b6ed108 req-a01e3164-6301-4e42-8654-8d8bfee47cba service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:43 user nova-compute[74638]: WARNING nova.compute.manager [req-9bf94372-bc39-4a5d-aea1-87697b6ed108 req-a01e3164-6301-4e42-8654-8d8bfee47cba service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state building and task_state spawning.
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:23:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance spawned successfully.
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:43 user nova-compute[74638]: INFO nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 08 20:23:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:23:43 user nova-compute[74638]: INFO nova.compute.manager [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Took 7.63 seconds to build instance.
Nov 08 20:23:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7d76ceb5-6f78-4cea-a42c-e367cdb7258a tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.138s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:23:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Creating image(s)
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Ensure instance console log exists: /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Start _get_guest_xml network_info=[{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1c5cc27a-0875-41b0-b43f-cda8ee857e18', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvkzcIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '560f5d57-098f-49ce-b9be-cf5f3c091bb7', 'attached_at': '', 'detached_at': '', 'volume_id': 'fec11291-8f97-42b8-9527-d95f5c5ab64d', 'serial': 'fec11291-8f97-42b8-9527-d95f5c5ab64d'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:23:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:23:54 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvkzcIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:23:54 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:23:54 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:23:54 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7140de19-8107-4dc3-9104-fcd449b28876]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:23:54 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4d4db-09e8-4d0c-877c-3903f0310729]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d] added
Nov 08 20:23:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[31257ae6-4b54-4573-87ee-d610876ed354]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[579d8b42-113f-44dd-a704-a71d154b673a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJvkzcIA {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJvkzcIA" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3789b2e-49ae-4400-865c-73becb13a82a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJvkzcIA'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c378ec9e-330c-45f6-9f58-27b0d66b0065]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eb716a-57ca-4f4e-8a1f-0da63a71281e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:23:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:23:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afb2800-7184-489f-9e27-b66fbc492d52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d, portal: 172.16.0.220,3260]
Nov 08 20:23:54 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d, portal: 172.16.0.220,3260] successful.
Nov 08 20:23:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06f7f31-8afc-4530-99bd-04fda0f1fff1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[875e2a3e-0791-4c87-a279-9c06729ee07f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:23:54 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:23:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:23:54 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:23:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[732fefe7-0c71-46b7-a89f-9e0038eef7c5]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvkzcIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:23:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26637373339323134', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637373339323134', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1811673025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1811673025',id=28,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-ksxmvhpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:23:17Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=560f5d57-098f-49ce-b9be-cf5f3c091bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3ad67f50-983b-43e0-ada8-5da7b9d5ef28,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad67f50-98') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'pci_devices' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:23:55 user nova-compute[74638]:   <uuid>560f5d57-098f-49ce-b9be-cf5f3c091bb7</uuid>
Nov 08 20:23:55 user nova-compute[74638]:   <name>instance-0000001c</name>
Nov 08 20:23:55 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:23:55 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:23:55 user nova-compute[74638]:   <metadata>
Nov 08 20:23:55 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:23:55 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:23:55 user nova-compute[74638]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1811673025</nova:name>
Nov 08 20:23:55 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:23:54</nova:creationTime>
Nov 08 20:23:55 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:23:55 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:23:55 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:23:55 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:23:55 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:23:55 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:23:55 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:23:55 user nova-compute[74638]:       <nova:owner>
Nov 08 20:23:55 user nova-compute[74638]:         <nova:user uuid="9ab02946569c47ff9772753454afc5b3">tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member</nova:user>
Nov 08 20:23:55 user nova-compute[74638]:         <nova:project uuid="9d69c08c247c41cd842c3673cf9af390">tempest-ServerBootFromVolumeStableRescueTest-1821986023</nova:project>
Nov 08 20:23:55 user nova-compute[74638]:       </nova:owner>
Nov 08 20:23:55 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:23:55 user nova-compute[74638]:       <nova:ports>
Nov 08 20:23:55 user nova-compute[74638]:         <nova:port uuid="3ad67f50-983b-43e0-ada8-5da7b9d5ef28">
Nov 08 20:23:55 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 20:23:55 user nova-compute[74638]:         </nova:port>
Nov 08 20:23:55 user nova-compute[74638]:       </nova:ports>
Nov 08 20:23:55 user nova-compute[74638]:     </nova:instance>
Nov 08 20:23:55 user nova-compute[74638]:   </metadata>
Nov 08 20:23:55 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:23:55 user nova-compute[74638]:     <system>
Nov 08 20:23:55 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:23:55 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:23:55 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:23:55 user nova-compute[74638]:       <entry name="serial">560f5d57-098f-49ce-b9be-cf5f3c091bb7</entry>
Nov 08 20:23:55 user nova-compute[74638]:       <entry name="uuid">560f5d57-098f-49ce-b9be-cf5f3c091bb7</entry>
Nov 08 20:23:55 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:23:55 user nova-compute[74638]:     </system>
Nov 08 20:23:55 user nova-compute[74638]:   </sysinfo>
Nov 08 20:23:55 user nova-compute[74638]:   <os>
Nov 08 20:23:55 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:23:55 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:23:55 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:23:55 user nova-compute[74638]:   </os>
Nov 08 20:23:55 user nova-compute[74638]:   <features>
Nov 08 20:23:55 user nova-compute[74638]:     <acpi/>
Nov 08 20:23:55 user nova-compute[74638]:     <apic/>
Nov 08 20:23:55 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:23:55 user nova-compute[74638]:   </features>
Nov 08 20:23:55 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:23:55 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:23:55 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:23:55 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:23:55 user nova-compute[74638]:   </clock>
Nov 08 20:23:55 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:23:55 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:23:55 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:23:55 user nova-compute[74638]:   </cpu>
Nov 08 20:23:55 user nova-compute[74638]:   <devices>
Nov 08 20:23:55 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:23:55 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:23:55 user nova-compute[74638]:       <source dev="/dev/sdb"/>
Nov 08 20:23:55 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:23:55 user nova-compute[74638]:       <serial>fec11291-8f97-42b8-9527-d95f5c5ab64d</serial>
Nov 08 20:23:55 user nova-compute[74638]:     </disk>
Nov 08 20:23:55 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:23:55 user nova-compute[74638]:       <mac address="fa:16:3e:23:44:e8"/>
Nov 08 20:23:55 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:23:55 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:23:55 user nova-compute[74638]:       <target dev="tap3ad67f50-98"/>
Nov 08 20:23:55 user nova-compute[74638]:     </interface>
Nov 08 20:23:55 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:23:55 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/console.log" append="off"/>
Nov 08 20:23:55 user nova-compute[74638]:     </serial>
Nov 08 20:23:55 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:23:55 user nova-compute[74638]:     <video>
Nov 08 20:23:55 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:23:55 user nova-compute[74638]:     </video>
Nov 08 20:23:55 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:23:55 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:23:55 user nova-compute[74638]:     </rng>
Nov 08 20:23:55 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:23:55 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:23:55 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:23:55 user nova-compute[74638]:     </memballoon>
Nov 08 20:23:55 user nova-compute[74638]:   </devices>
Nov 08 20:23:55 user nova-compute[74638]: </domain>
Nov 08 20:23:55 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1811673025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1811673025',id=28,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-ksxmvhpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:23:17Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=560f5d57-098f-49ce-b9be-cf5f3c091bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3ad67f50-983b-43e0-ada8-5da7b9d5ef28,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad67f50-98') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG os_vif [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3ad67f50-983b-43e0-ada8-5da7b9d5ef28,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad67f50-98') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ad189a8-02e1-5c1e-a251-42c7e36c09cc', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ad67f50-98, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ad67f50-98, col_values=(('qos', UUID('adb9725a-f52e-4dd3-bdef-505276403fd3')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ad67f50-98, col_values=(('external_ids', {'iface-id': '3ad67f50-983b-43e0-ada8-5da7b9d5ef28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:44:e8', 'vm-uuid': '560f5d57-098f-49ce-b9be-cf5f3c091bb7'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:55 user nova-compute[74638]: INFO os_vif [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3ad67f50-983b-43e0-ada8-5da7b9d5ef28,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad67f50-98')
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:23:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No VIF found with MAC fa:16:3e:23:44:e8, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-fd52cf23-7e3a-4e08-9461-613590d8d915 req-5f628e79-136d-4e63-afaa-0ae37a5f98c8 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd52cf23-7e3a-4e08-9461-613590d8d915 req-5f628e79-136d-4e63-afaa-0ae37a5f98c8 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd52cf23-7e3a-4e08-9461-613590d8d915 req-5f628e79-136d-4e63-afaa-0ae37a5f98c8 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fd52cf23-7e3a-4e08-9461-613590d8d915 req-5f628e79-136d-4e63-afaa-0ae37a5f98c8 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-fd52cf23-7e3a-4e08-9461-613590d8d915 req-5f628e79-136d-4e63-afaa-0ae37a5f98c8 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:57 user nova-compute[74638]: WARNING nova.compute.manager [req-fd52cf23-7e3a-4e08-9461-613590d8d915 req-5f628e79-136d-4e63-afaa-0ae37a5f98c8 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state building and task_state spawning.
Nov 08 20:23:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:23:59 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance spawned successfully.
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:23:59 user nova-compute[74638]: INFO nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:23:59 user nova-compute[74638]: INFO nova.compute.manager [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Took 43.81 seconds to build instance.
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.compute.manager [req-702f2bcc-1b8d-4dda-9415-11d116729225 req-e68f8e69-d819-4b82-9151-4720f7d0be5a service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-702f2bcc-1b8d-4dda-9415-11d116729225 req-e68f8e69-d819-4b82-9151-4720f7d0be5a service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-702f2bcc-1b8d-4dda-9415-11d116729225 req-e68f8e69-d819-4b82-9151-4720f7d0be5a service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-702f2bcc-1b8d-4dda-9415-11d116729225 req-e68f8e69-d819-4b82-9151-4720f7d0be5a service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:23:59 user nova-compute[74638]: DEBUG nova.compute.manager [req-702f2bcc-1b8d-4dda-9415-11d116729225 req-e68f8e69-d819-4b82-9151-4720f7d0be5a service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:23:59 user nova-compute[74638]: WARNING nova.compute.manager [req-702f2bcc-1b8d-4dda-9415-11d116729225 req-e68f8e69-d819-4b82-9151-4720f7d0be5a service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state active and task_state None.
Nov 08 20:23:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a441356e-b741-406b-8012-37184ebd5b97 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.905s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:24:03 user nova-compute[74638]: INFO nova.compute.claims [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Claim successful on node user
Nov 08 20:24:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:24:03 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.network.neutron [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:24:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.policy [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '875fdd7768654b8e8c261749bbb1c78e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a945ba0f2d41aa9cd7ad8dfd3ea0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:24:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Creating image(s)
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "/opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "/opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.171s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk 1073741824" returned: 0 in 0.059s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:04 user nova-compute[74638]: DEBUG nova.network.neutron [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Successfully created port: 56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Cannot resize image /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Ensure instance console log exists: /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.network.neutron [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Successfully updated port: 56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquired lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.network.neutron [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-7a308725-3b44-445d-bcaf-4b63fa2b64b3 req-2a494b3a-304c-4221-b6d6-262a0235e53c service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received event network-changed-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-7a308725-3b44-445d-bcaf-4b63fa2b64b3 req-2a494b3a-304c-4221-b6d6-262a0235e53c service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Refreshing instance network info cache due to event network-changed-56275862-8342-4215-94b1-e6a8ecb2a2be. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7a308725-3b44-445d-bcaf-4b63fa2b64b3 req-2a494b3a-304c-4221-b6d6-262a0235e53c service nova] Acquiring lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG nova.network.neutron [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.network.neutron [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Updating instance_info_cache with network_info: [{"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Releasing lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Instance network_info: |[{"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7a308725-3b44-445d-bcaf-4b63fa2b64b3 req-2a494b3a-304c-4221-b6d6-262a0235e53c service nova] Acquired lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-7a308725-3b44-445d-bcaf-4b63fa2b64b3 req-2a494b3a-304c-4221-b6d6-262a0235e53c service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Refreshing network info cache for port 56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Start _get_guest_xml network_info=[{"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:24:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:24:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1993136005',display_name='tempest-VolumesSnapshotTestJSON-instance-1993136005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1993136005',id=31,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKTOisfJhCcBcTcrsUiif69kGEPj92H8Ku9QBD3wcSxc5b7j7jcGZeLGHI+2k0MBFgOqujm3jfp5YPt3K/RC31vz+ymwIPax4gty4FAKYm1nXMtjEUEx5oxTdQ4IltpvA==',key_name='tempest-keypair-1676801169',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a945ba0f2d41aa9cd7ad8dfd3ea0a3',ramdisk_id='',reservation_id='r-xryuaauz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1022894138',owner_user_name='tempest-VolumesSnapshotTestJSON-1022894138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875fdd7768654b8e8c261749bbb1c78e',uuid=a7641b40-ef53-404c-9810-0e7c0e933681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converting VIF {"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=56275862-8342-4215-94b1-e6a8ecb2a2be,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56275862-83') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'pci_devices' on Instance uuid a7641b40-ef53-404c-9810-0e7c0e933681 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:24:06 user nova-compute[74638]:   <uuid>a7641b40-ef53-404c-9810-0e7c0e933681</uuid>
Nov 08 20:24:06 user nova-compute[74638]:   <name>instance-0000001f</name>
Nov 08 20:24:06 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:24:06 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:24:06 user nova-compute[74638]:   <metadata>
Nov 08 20:24:06 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:24:06 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:24:06 user nova-compute[74638]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1993136005</nova:name>
Nov 08 20:24:06 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:24:06</nova:creationTime>
Nov 08 20:24:06 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:24:06 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:24:06 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:24:06 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:24:06 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:24:06 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:24:06 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:24:06 user nova-compute[74638]:       <nova:owner>
Nov 08 20:24:06 user nova-compute[74638]:         <nova:user uuid="875fdd7768654b8e8c261749bbb1c78e">tempest-VolumesSnapshotTestJSON-1022894138-project-member</nova:user>
Nov 08 20:24:06 user nova-compute[74638]:         <nova:project uuid="e6a945ba0f2d41aa9cd7ad8dfd3ea0a3">tempest-VolumesSnapshotTestJSON-1022894138</nova:project>
Nov 08 20:24:06 user nova-compute[74638]:       </nova:owner>
Nov 08 20:24:06 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:24:06 user nova-compute[74638]:       <nova:ports>
Nov 08 20:24:06 user nova-compute[74638]:         <nova:port uuid="56275862-8342-4215-94b1-e6a8ecb2a2be">
Nov 08 20:24:06 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 20:24:06 user nova-compute[74638]:         </nova:port>
Nov 08 20:24:06 user nova-compute[74638]:       </nova:ports>
Nov 08 20:24:06 user nova-compute[74638]:     </nova:instance>
Nov 08 20:24:06 user nova-compute[74638]:   </metadata>
Nov 08 20:24:06 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:24:06 user nova-compute[74638]:     <system>
Nov 08 20:24:06 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:24:06 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:24:06 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:24:06 user nova-compute[74638]:       <entry name="serial">a7641b40-ef53-404c-9810-0e7c0e933681</entry>
Nov 08 20:24:06 user nova-compute[74638]:       <entry name="uuid">a7641b40-ef53-404c-9810-0e7c0e933681</entry>
Nov 08 20:24:06 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:24:06 user nova-compute[74638]:     </system>
Nov 08 20:24:06 user nova-compute[74638]:   </sysinfo>
Nov 08 20:24:06 user nova-compute[74638]:   <os>
Nov 08 20:24:06 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:24:06 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:24:06 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:24:06 user nova-compute[74638]:   </os>
Nov 08 20:24:06 user nova-compute[74638]:   <features>
Nov 08 20:24:06 user nova-compute[74638]:     <acpi/>
Nov 08 20:24:06 user nova-compute[74638]:     <apic/>
Nov 08 20:24:06 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:24:06 user nova-compute[74638]:   </features>
Nov 08 20:24:06 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:24:06 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:24:06 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:24:06 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:24:06 user nova-compute[74638]:   </clock>
Nov 08 20:24:06 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:24:06 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:24:06 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:24:06 user nova-compute[74638]:   </cpu>
Nov 08 20:24:06 user nova-compute[74638]:   <devices>
Nov 08 20:24:06 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:24:06 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:24:06 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk"/>
Nov 08 20:24:06 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:24:06 user nova-compute[74638]:     </disk>
Nov 08 20:24:06 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:24:06 user nova-compute[74638]:       <mac address="fa:16:3e:13:6e:06"/>
Nov 08 20:24:06 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:24:06 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:24:06 user nova-compute[74638]:       <target dev="tap56275862-83"/>
Nov 08 20:24:06 user nova-compute[74638]:     </interface>
Nov 08 20:24:06 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:24:06 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/console.log" append="off"/>
Nov 08 20:24:06 user nova-compute[74638]:     </serial>
Nov 08 20:24:06 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:24:06 user nova-compute[74638]:     <video>
Nov 08 20:24:06 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:24:06 user nova-compute[74638]:     </video>
Nov 08 20:24:06 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:24:06 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:24:06 user nova-compute[74638]:     </rng>
Nov 08 20:24:06 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:24:06 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:24:06 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:24:06 user nova-compute[74638]:     </memballoon>
Nov 08 20:24:06 user nova-compute[74638]:   </devices>
Nov 08 20:24:06 user nova-compute[74638]: </domain>
Nov 08 20:24:06 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1993136005',display_name='tempest-VolumesSnapshotTestJSON-instance-1993136005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1993136005',id=31,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKTOisfJhCcBcTcrsUiif69kGEPj92H8Ku9QBD3wcSxc5b7j7jcGZeLGHI+2k0MBFgOqujm3jfp5YPt3K/RC31vz+ymwIPax4gty4FAKYm1nXMtjEUEx5oxTdQ4IltpvA==',key_name='tempest-keypair-1676801169',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6a945ba0f2d41aa9cd7ad8dfd3ea0a3',ramdisk_id='',reservation_id='r-xryuaauz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1022894138',owner_user_name='tempest-VolumesSnapshotTestJSON-1022894138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875fdd7768654b8e8c261749bbb1c78e',uuid=a7641b40-ef53-404c-9810-0e7c0e933681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converting VIF {"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=56275862-8342-4215-94b1-e6a8ecb2a2be,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56275862-83') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG os_vif [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=56275862-8342-4215-94b1-e6a8ecb2a2be,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56275862-83') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2224eb1-e07b-593d-8c47-292e4b23d2da', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56275862-83, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56275862-83, col_values=(('qos', UUID('41294de1-115b-49fd-8772-34f2a23ef2ab')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56275862-83, col_values=(('external_ids', {'iface-id': '56275862-8342-4215-94b1-e6a8ecb2a2be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6e:06', 'vm-uuid': 'a7641b40-ef53-404c-9810-0e7c0e933681'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:06 user nova-compute[74638]: INFO os_vif [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=56275862-8342-4215-94b1-e6a8ecb2a2be,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56275862-83')
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No VIF found with MAC fa:16:3e:13:6e:06, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-7a308725-3b44-445d-bcaf-4b63fa2b64b3 req-2a494b3a-304c-4221-b6d6-262a0235e53c service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Updated VIF entry in instance network info cache for port 56275862-8342-4215-94b1-e6a8ecb2a2be. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-7a308725-3b44-445d-bcaf-4b63fa2b64b3 req-2a494b3a-304c-4221-b6d6-262a0235e53c service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Updating instance_info_cache with network_info: [{"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7a308725-3b44-445d-bcaf-4b63fa2b64b3 req-2a494b3a-304c-4221-b6d6-262a0235e53c service nova] Releasing lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-cfc70a10-11c8-4c5e-9eb8-9a06246ab7a4 req-e546a730-f567-464b-b9a9-3193ca0fc46c service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received event network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cfc70a10-11c8-4c5e-9eb8-9a06246ab7a4 req-e546a730-f567-464b-b9a9-3193ca0fc46c service nova] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cfc70a10-11c8-4c5e-9eb8-9a06246ab7a4 req-e546a730-f567-464b-b9a9-3193ca0fc46c service nova] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cfc70a10-11c8-4c5e-9eb8-9a06246ab7a4 req-e546a730-f567-464b-b9a9-3193ca0fc46c service nova] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-cfc70a10-11c8-4c5e-9eb8-9a06246ab7a4 req-e546a730-f567-464b-b9a9-3193ca0fc46c service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] No waiting events found dispatching network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:24:07 user nova-compute[74638]: WARNING nova.compute.manager [req-cfc70a10-11c8-4c5e-9eb8-9a06246ab7a4 req-e546a730-f567-464b-b9a9-3193ca0fc46c service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received unexpected event network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be for instance with vm_state building and task_state spawning.
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:24:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7914MB free_disk=25.213214874267578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 491aafd0-a4dd-4cb2-9584-e88c39367878 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a7641b40-ef53-404c-9810-0e7c0e933681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:24:09 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Instance spawned successfully.
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:24:09 user nova-compute[74638]: INFO nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-f84e85b4-364a-4ec2-8935-458f2879e183 req-af77aad0-a414-458a-88bc-b4ba6d790ea1 service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received event network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f84e85b4-364a-4ec2-8935-458f2879e183 req-af77aad0-a414-458a-88bc-b4ba6d790ea1 service nova] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f84e85b4-364a-4ec2-8935-458f2879e183 req-af77aad0-a414-458a-88bc-b4ba6d790ea1 service nova] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f84e85b4-364a-4ec2-8935-458f2879e183 req-af77aad0-a414-458a-88bc-b4ba6d790ea1 service nova] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-f84e85b4-364a-4ec2-8935-458f2879e183 req-af77aad0-a414-458a-88bc-b4ba6d790ea1 service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] No waiting events found dispatching network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:24:09 user nova-compute[74638]: WARNING nova.compute.manager [req-f84e85b4-364a-4ec2-8935-458f2879e183 req-af77aad0-a414-458a-88bc-b4ba6d790ea1 service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received unexpected event network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be for instance with vm_state building and task_state spawning.
Nov 08 20:24:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:24:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:09 user nova-compute[74638]: INFO nova.compute.manager [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Took 6.43 seconds to build instance.
Nov 08 20:24:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efa1116f-9d65-475d-95d4-780e9dd6c329 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.520s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:24:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:24:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:24:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:24:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:24:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:32 user nova-compute[74638]: INFO nova.compute.manager [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Unshelving
Nov 08 20:24:32 user nova-compute[74638]: INFO nova.virt.block_device [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Booting with volume 5beee78f-0980-4417-89d7-d5ce71a67cb5 at /dev/vdc
Nov 08 20:24:32 user nova-compute[74638]: DEBUG os_brick.utils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f9a2b2-bfd9-4d78-8094-11dcd3567aa8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6260a8-c016-4e30-9a6b-7e83771be7c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:24:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad3797-7926-4e9f-b020-f77b20a5db1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[af132c08-8011-4067-ad48-74781324d066]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:24:33 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:24:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c696d8e0-0dc6-4944-924b-b2991d140641]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG os_brick.utils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating existing volume attachment record: f345a69f-1f6a-4cac-862a-8e9c4bfb4e37 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:24:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:42 user nova-compute[74638]: INFO nova.compute.manager [None req-d8f69d7e-a5fb-499b-b511-380b85398466 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Get console output
Nov 08 20:24:42 user nova-compute[74638]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 20:24:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:24:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:24:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:24:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:24:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:24:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:24:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:56 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'pci_requests' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:24:56 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:24:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:24:56 user nova-compute[74638]: INFO nova.compute.claims [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Claim successful on node user
Nov 08 20:24:56 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:24:56 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:24:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:57 user nova-compute[74638]: INFO nova.network.neutron [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 20:24:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:24:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquired lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:24:57 user nova-compute[74638]: DEBUG nova.network.neutron [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:24:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0b38c2-ba6b-4ad1-8e8a-b65315ef50a8 req-7e651437-5650-4bc2-8b96-fedf3352cdf3 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-changed-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:24:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-2b0b38c2-ba6b-4ad1-8e8a-b65315ef50a8 req-7e651437-5650-4bc2-8b96-fedf3352cdf3 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Refreshing instance network info cache due to event network-changed-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:24:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0b38c2-ba6b-4ad1-8e8a-b65315ef50a8 req-7e651437-5650-4bc2-8b96-fedf3352cdf3 service nova] Acquiring lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating instance_info_cache with network_info: [{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Releasing lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:24:58 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Creating image(s)
Nov 08 20:24:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0b38c2-ba6b-4ad1-8e8a-b65315ef50a8 req-7e651437-5650-4bc2-8b96-fedf3352cdf3 service nova] Acquired lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG nova.network.neutron [req-2b0b38c2-ba6b-4ad1-8e8a-b65315ef50a8 req-7e651437-5650-4bc2-8b96-fedf3352cdf3 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Refreshing network info cache for port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG nova.objects.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<0f9039b6-fc00-4956-ae26-a17f2886396b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "b051ce37e1311128c2eb37df9827de7dab0228bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:24:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "b051ce37e1311128c2eb37df9827de7dab0228bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc.part --force-share --output=json" returned: 0 in 0.209s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG nova.virt.images [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] 8dd3e970-a395-4201-b210-6983a40fb63b was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc.part /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG nova.network.neutron [req-2b0b38c2-ba6b-4ad1-8e8a-b65315ef50a8 req-7e651437-5650-4bc2-8b96-fedf3352cdf3 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updated VIF entry in instance network info cache for port 0355f8aa-41f3-4cd9-8c77-e0daf1a9959e. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG nova.network.neutron [req-2b0b38c2-ba6b-4ad1-8e8a-b65315ef50a8 req-7e651437-5650-4bc2-8b96-fedf3352cdf3 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating instance_info_cache with network_info: [{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2b0b38c2-ba6b-4ad1-8e8a-b65315ef50a8 req-7e651437-5650-4bc2-8b96-fedf3352cdf3 service nova] Releasing lock "refresh_cache-0f9039b6-fc00-4956-ae26-a17f2886396b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc.part /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc.converted" returned: 0 in 0.308s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:24:59 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "b051ce37e1311128c2eb37df9827de7dab0228bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.780s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "b051ce37e1311128c2eb37df9827de7dab0228bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "b051ce37e1311128c2eb37df9827de7dab0228bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc,backing_fmt=raw /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc,backing_fmt=raw /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk 1073741824" returned: 0 in 0.060s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "b051ce37e1311128c2eb37df9827de7dab0228bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'migration_context' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG nova.objects.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<0f9039b6-fc00-4956-ae26-a17f2886396b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:25:00 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Rebasing disk image.
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:00 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 -F raw /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:25:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 -F raw /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk" returned: 0 in 2.055s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:25:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Ensure instance console log exists: /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:25:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Start _get_guest_xml network_info=[{"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ee9b161b8ebaf46e04e7edae51b5bb7b',container_format='bare',created_at=2023-11-08T20:22:40Z,direct_url=<?>,disk_format='qcow2',id=8dd3e970-a395-4201-b210-6983a40fb63b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1143454668-shelved',owner='ad76637f4c184691893fc1c41cb6d08c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T20:22:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'f345a69f-1f6a-4cac-862a-8e9c4bfb4e37', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OXNxCiqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0f9039b6-fc00-4956-ae26-a17f2886396b', 'attached_at': '', 'detached_at': '', 'volume_id': '5beee78f-0980-4417-89d7-d5ce71a67cb5', 'serial': '5beee78f-0980-4417-89d7-d5ce71a67cb5'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:25:03 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:25:03 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ee9b161b8ebaf46e04e7edae51b5bb7b',container_format='bare',created_at=2023-11-08T20:22:40Z,direct_url=<?>,disk_format='qcow2',id=8dd3e970-a395-4201-b210-6983a40fb63b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1143454668-shelved',owner='ad76637f4c184691893fc1c41cb6d08c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T20:22:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.objects.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<0f9039b6-fc00-4956-ae26-a17f2886396b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OXNxCiqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:25:03 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:25:03 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:25:03 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260" returned: 21 in 0.048s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c801964-2cce-4008-a656-1529e50aa3ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:25:03 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[45df1dda-5ae9-4caa-bff9-df2ec93ce771]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5] added
Nov 08 20:25:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[946a2248-7ed7-41b7-8552-593f2df5c504]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9a5ba2-71ac-4b68-ac4a-d48ec0ecb129]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OXNxCiqz {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OXNxCiqz" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6b2110-c599-4053-8d9c-ac1db2617be7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OXNxCiqz'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f504c1d2-987a-4336-b3f6-bed0fd0947c2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[783c7b28-37ce-4fa1-839e-4027224cac7f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:25:03 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:25:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:25:03 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:25:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56fc252-654d-4ea4-8de4-6326a9b103bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5, portal: 172.16.0.220,3260]
Nov 08 20:25:03 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5, portal: 172.16.0.220,3260] successful.
Nov 08 20:25:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[62acbecd-5da1-41bf-8697-ce29d0a621c0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e856ff3-1307-44bc-850f-95ecadd1b13b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:25:03 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:25:03 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:25:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:25:03 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:25:03 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:25:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccef60ba-ce7d-4e3f-afe9-ce5111c206e4]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OXNxCiqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26363393461636332', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363393461636332', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1143454668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1143454668',id=26,image_ref='8dd3e970-a395-4201-b210-6983a40fb63b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1222414860',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-15l2jril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member',shelved_at='2023-11-08T20:22:44.455130',shelved_host='user',shelved_image_id='8dd3e970-a395-4201-b210-6983a40fb63b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=0f9039b6-fc00-4956-ae26-a17f2886396b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.objects.base [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<0f9039b6-fc00-4956-ae26-a17f2886396b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:25:04 user nova-compute[74638]:   <uuid>0f9039b6-fc00-4956-ae26-a17f2886396b</uuid>
Nov 08 20:25:04 user nova-compute[74638]:   <name>instance-0000001a</name>
Nov 08 20:25:04 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:25:04 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:25:04 user nova-compute[74638]:   <metadata>
Nov 08 20:25:04 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:25:04 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:25:04 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1143454668</nova:name>
Nov 08 20:25:04 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:25:03</nova:creationTime>
Nov 08 20:25:04 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:25:04 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:25:04 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:25:04 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:25:04 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:25:04 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:25:04 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:25:04 user nova-compute[74638]:       <nova:owner>
Nov 08 20:25:04 user nova-compute[74638]:         <nova:user uuid="e5d2a2e56dfc441ea12bfe9a89527a2d">tempest-AttachVolumeShelveTestJSON-1349495348-project-member</nova:user>
Nov 08 20:25:04 user nova-compute[74638]:         <nova:project uuid="ad76637f4c184691893fc1c41cb6d08c">tempest-AttachVolumeShelveTestJSON-1349495348</nova:project>
Nov 08 20:25:04 user nova-compute[74638]:       </nova:owner>
Nov 08 20:25:04 user nova-compute[74638]:       <nova:root type="image" uuid="8dd3e970-a395-4201-b210-6983a40fb63b"/>
Nov 08 20:25:04 user nova-compute[74638]:       <nova:ports>
Nov 08 20:25:04 user nova-compute[74638]:         <nova:port uuid="0355f8aa-41f3-4cd9-8c77-e0daf1a9959e">
Nov 08 20:25:04 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 20:25:04 user nova-compute[74638]:         </nova:port>
Nov 08 20:25:04 user nova-compute[74638]:       </nova:ports>
Nov 08 20:25:04 user nova-compute[74638]:     </nova:instance>
Nov 08 20:25:04 user nova-compute[74638]:   </metadata>
Nov 08 20:25:04 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:25:04 user nova-compute[74638]:     <system>
Nov 08 20:25:04 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:25:04 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:25:04 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:25:04 user nova-compute[74638]:       <entry name="serial">0f9039b6-fc00-4956-ae26-a17f2886396b</entry>
Nov 08 20:25:04 user nova-compute[74638]:       <entry name="uuid">0f9039b6-fc00-4956-ae26-a17f2886396b</entry>
Nov 08 20:25:04 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:25:04 user nova-compute[74638]:     </system>
Nov 08 20:25:04 user nova-compute[74638]:   </sysinfo>
Nov 08 20:25:04 user nova-compute[74638]:   <os>
Nov 08 20:25:04 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:25:04 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:25:04 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:25:04 user nova-compute[74638]:   </os>
Nov 08 20:25:04 user nova-compute[74638]:   <features>
Nov 08 20:25:04 user nova-compute[74638]:     <acpi/>
Nov 08 20:25:04 user nova-compute[74638]:     <apic/>
Nov 08 20:25:04 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:25:04 user nova-compute[74638]:   </features>
Nov 08 20:25:04 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:25:04 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:25:04 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:25:04 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:25:04 user nova-compute[74638]:   </clock>
Nov 08 20:25:04 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:25:04 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:25:04 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:25:04 user nova-compute[74638]:   </cpu>
Nov 08 20:25:04 user nova-compute[74638]:   <devices>
Nov 08 20:25:04 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:25:04 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:25:04 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk"/>
Nov 08 20:25:04 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:25:04 user nova-compute[74638]:     </disk>
Nov 08 20:25:04 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:25:04 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:25:04 user nova-compute[74638]:       <source dev="/dev/sdd"/>
Nov 08 20:25:04 user nova-compute[74638]:       <target dev="vdc" bus="virtio"/>
Nov 08 20:25:04 user nova-compute[74638]:       <serial>5beee78f-0980-4417-89d7-d5ce71a67cb5</serial>
Nov 08 20:25:04 user nova-compute[74638]:     </disk>
Nov 08 20:25:04 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:25:04 user nova-compute[74638]:       <mac address="fa:16:3e:e8:d2:87"/>
Nov 08 20:25:04 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:25:04 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:25:04 user nova-compute[74638]:       <target dev="tap0355f8aa-41"/>
Nov 08 20:25:04 user nova-compute[74638]:     </interface>
Nov 08 20:25:04 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:25:04 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/console.log" append="off"/>
Nov 08 20:25:04 user nova-compute[74638]:     </serial>
Nov 08 20:25:04 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:25:04 user nova-compute[74638]:     <video>
Nov 08 20:25:04 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:25:04 user nova-compute[74638]:     </video>
Nov 08 20:25:04 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:25:04 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:25:04 user nova-compute[74638]:     </rng>
Nov 08 20:25:04 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:25:04 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:25:04 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:25:04 user nova-compute[74638]:     </memballoon>
Nov 08 20:25:04 user nova-compute[74638]:   </devices>
Nov 08 20:25:04 user nova-compute[74638]: </domain>
Nov 08 20:25:04 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1143454668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1143454668',id=26,image_ref='8dd3e970-a395-4201-b210-6983a40fb63b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1222414860',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-15l2jril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member',shelved_at='2023-11-08T20:22:44.455130',shelved_host='user',shelved_image_id='8dd3e970-a395-4201-b210-6983a40fb63b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:24:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=0f9039b6-fc00-4956-ae26-a17f2886396b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG os_vif [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d44b95a-4c63-525c-98cc-426fabd4619e', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0355f8aa-41, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0355f8aa-41, col_values=(('qos', UUID('1e231d69-3d62-451e-aed8-2d0dc8d83379')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0355f8aa-41, col_values=(('external_ids', {'iface-id': '0355f8aa-41f3-4cd9-8c77-e0daf1a9959e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:d2:87', 'vm-uuid': '0f9039b6-fc00-4956-ae26-a17f2886396b'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:04 user nova-compute[74638]: INFO os_vif [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41')
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:25:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No VIF found with MAC fa:16:3e:e8:d2:87, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:25:05 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:25:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:25:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:25:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:25:05 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:25:05 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-0bb3f463-a8c7-464d-b739-bfa8472d0734 req-8781e28e-0800-415d-8297-c3dafe54f425 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bb3f463-a8c7-464d-b739-bfa8472d0734 req-8781e28e-0800-415d-8297-c3dafe54f425 service nova] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bb3f463-a8c7-464d-b739-bfa8472d0734 req-8781e28e-0800-415d-8297-c3dafe54f425 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0bb3f463-a8c7-464d-b739-bfa8472d0734 req-8781e28e-0800-415d-8297-c3dafe54f425 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-0bb3f463-a8c7-464d-b739-bfa8472d0734 req-8781e28e-0800-415d-8297-c3dafe54f425 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] No waiting events found dispatching network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:25:06 user nova-compute[74638]: WARNING nova.compute.manager [req-0bb3f463-a8c7-464d-b739-bfa8472d0734 req-8781e28e-0800-415d-8297-c3dafe54f425 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received unexpected event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 20:25:06 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [{"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:06 user nova-compute[74638]: INFO nova.compute.manager [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Rescuing
Nov 08 20:25:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquired lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG nova.network.neutron [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:25:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating instance_info_cache with network_info: [{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Releasing lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-b4afb010-7a35-46d8-8743-dd3e5df9174a req-1f1393bb-6707-43cb-a930-7a3796c313bc service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b4afb010-7a35-46d8-8743-dd3e5df9174a req-1f1393bb-6707-43cb-a930-7a3796c313bc service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b4afb010-7a35-46d8-8743-dd3e5df9174a req-1f1393bb-6707-43cb-a930-7a3796c313bc service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b4afb010-7a35-46d8-8743-dd3e5df9174a req-1f1393bb-6707-43cb-a930-7a3796c313bc service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-b4afb010-7a35-46d8-8743-dd3e5df9174a req-1f1393bb-6707-43cb-a930-7a3796c313bc service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:25:07 user nova-compute[74638]: WARNING nova.compute.manager [req-b4afb010-7a35-46d8-8743-dd3e5df9174a req-1f1393bb-6707-43cb-a930-7a3796c313bc service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state active and task_state rescuing.
Nov 08 20:25:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:08 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance destroyed successfully.
Nov 08 20:25:08 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Attempting a stable device rescue
Nov 08 20:25:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74638) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 20:25:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance directory exists: not creating {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 20:25:08 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Creating image(s)
Nov 08 20:25:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "/opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "/opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "/opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:08 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'trusted_certs' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "b2970da4f7013bec5f746ce9bcb89b20d539cc6f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "b2970da4f7013bec5f746ce9bcb89b20d539cc6f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-4d9267d3-09a0-4725-b010-32b987169273 req-62125aeb-dccd-453a-bbc8-01edbf77f7c6 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4d9267d3-09a0-4725-b010-32b987169273 req-62125aeb-dccd-453a-bbc8-01edbf77f7c6 service nova] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4d9267d3-09a0-4725-b010-32b987169273 req-62125aeb-dccd-453a-bbc8-01edbf77f7c6 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4d9267d3-09a0-4725-b010-32b987169273 req-62125aeb-dccd-453a-bbc8-01edbf77f7c6 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-4d9267d3-09a0-4725-b010-32b987169273 req-62125aeb-dccd-453a-bbc8-01edbf77f7c6 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] No waiting events found dispatching network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:25:09 user nova-compute[74638]: WARNING nova.compute.manager [req-4d9267d3-09a0-4725-b010-32b987169273 req-62125aeb-dccd-453a-bbc8-01edbf77f7c6 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received unexpected event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:09 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance spawned successfully.
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f.part --force-share --output=json" returned: 0 in 0.275s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.virt.images [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] b84a4571-e498-48fe-84b8-a6785fc82a25 was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f.part /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-b0f9cf00-218f-46b7-8586-72cfe2430caa req-289366cb-eec1-44e4-a608-0a2e982b8ff5 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b0f9cf00-218f-46b7-8586-72cfe2430caa req-289366cb-eec1-44e4-a608-0a2e982b8ff5 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b0f9cf00-218f-46b7-8586-72cfe2430caa req-289366cb-eec1-44e4-a608-0a2e982b8ff5 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b0f9cf00-218f-46b7-8586-72cfe2430caa req-289366cb-eec1-44e4-a608-0a2e982b8ff5 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-b0f9cf00-218f-46b7-8586-72cfe2430caa req-289366cb-eec1-44e4-a608-0a2e982b8ff5 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:25:09 user nova-compute[74638]: WARNING nova.compute.manager [req-b0f9cf00-218f-46b7-8586-72cfe2430caa req-289366cb-eec1-44e4-a608-0a2e982b8ff5 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state active and task_state rescuing.
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6209e2fd-533e-456b-b483-2378f1fe4fa5 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 37.497s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f.part /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f.converted" returned: 0 in 0.500s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "b2970da4f7013bec5f746ce9bcb89b20d539cc6f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.039s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "b2970da4f7013bec5f746ce9bcb89b20d539cc6f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "b2970da4f7013bec5f746ce9bcb89b20d539cc6f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f,backing_fmt=raw /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f,backing_fmt=raw /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue" returned: 0 in 0.051s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "b2970da4f7013bec5f746ce9bcb89b20d539cc6f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'migration_context' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.objects.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<560f5d57-098f-49ce-b9be-cf5f3c091bb7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Start _get_guest_xml network_info=[{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "vif_mac": "fa:16:3e:23:44:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b84a4571-e498-48fe-84b8-a6785fc82a25', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1c5cc27a-0875-41b0-b43f-cda8ee857e18', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvkzcIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '560f5d57-098f-49ce-b9be-cf5f3c091bb7', 'attached_at': '', 'detached_at': '', 'volume_id': 'fec11291-8f97-42b8-9527-d95f5c5ab64d', 'serial': 'fec11291-8f97-42b8-9527-d95f5c5ab64d'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'resources' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.objects.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<560f5d57-098f-49ce-b9be-cf5f3c091bb7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'numa_topology' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.objects.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<560f5d57-098f-49ce-b9be-cf5f3c091bb7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:25:10 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:25:10 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'vcpu_model' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.objects.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<560f5d57-098f-49ce-b9be-cf5f3c091bb7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvkzcIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:25:10 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:25:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:25:10 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:25:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:25:10 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb4030-3ae5-458e-8cfa-07b3d33f4a19]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lJvkzcIA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 20:25:10 user nova-compute[74638]: node.name = iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:25:10 user nova-compute[74638]: node.tpgt = -1
Nov 08 20:25:10 user nova-compute[74638]: node.startup = automatic
Nov 08 20:25:10 user nova-compute[74638]: node.leading_login = No
Nov 08 20:25:10 user nova-compute[74638]: iface.iscsi_ifacename = default
Nov 08 20:25:10 user nova-compute[74638]: iface.net_ifacename = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.ipaddress = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.prefix_len = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.hwaddress = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.transport_name = tcp
Nov 08 20:25:10 user nova-compute[74638]: iface.initiatorname = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.state = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.vlan_id = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.vlan_priority = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.vlan_state = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.iface_num = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.mtu = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.port = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.bootproto = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.subnet_mask = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.gateway = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.dhcp_alt_client_id = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.dhcp_dns = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.dhcp_learn_iqn = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.dhcp_vendor_id_state = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.dhcp_vendor_id = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.dhcp_slp_da = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.fragmentation = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.gratuitous_arp = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.incoming_forwarding = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.tos_state = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.tos = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.ttl = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.delayed_ack = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.tcp_nagle = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.tcp_wsf_state = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.tcp_wsf = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.tcp_timer_scale = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.tcp_timestamp = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.redirect = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.def_task_mgmt_timeout = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.header_digest = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.data_digest = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.immediate_data = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.initial_r2t = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.data_seq_inorder = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.data_pdu_inorder = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.erl = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.max_receive_data_len = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.first_burst_len = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.max_outstanding_r2t = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.max_burst_len = 0
Nov 08 20:25:10 user nova-compute[74638]: iface.chap_auth = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.bidi_chap = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.strict_login_compliance = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.discovery_auth = <empty>
Nov 08 20:25:10 user nova-compute[74638]: iface.discovery_logout = <empty>
Nov 08 20:25:10 user nova-compute[74638]: node.discovery_address = <empty>
Nov 08 20:25:10 user nova-compute[74638]: node.discovery_port = 0
Nov 08 20:25:10 user nova-compute[74638]: node.discovery_type = static
Nov 08 20:25:10 user nova-compute[74638]: node.session.initial_cmdsn = 0
Nov 08 20:25:10 user nova-compute[74638]: node.session.initial_login_retry_max = 8
Nov 08 20:25:10 user nova-compute[74638]: node.session.xmit_thread_priority = -20
Nov 08 20:25:10 user nova-compute[74638]: node.session.cmds_max = 128
Nov 08 20:25:10 user nova-compute[74638]: node.session.queue_depth = 32
Nov 08 20:25:10 user nova-compute[74638]: node.session.nr_sessions = 1
Nov 08 20:25:10 user nova-compute[74638]: node.session.auth.authmethod = CHAP
Nov 08 20:25:10 user nova-compute[74638]: node.session.auth.username = lJvkzcIA
Nov 08 20:25:10 user nova-compute[74638]: node.session.auth.password = ***
Nov 08 20:25:10 user nova-compute[74638]: node.session.auth.username_in = <empty>
Nov 08 20:25:10 user nova-compute[74638]: node.session.auth.password_in = <empty>
Nov 08 20:25:10 user nova-compute[74638]: node.session.auth.chap_algs = MD5
Nov 08 20:25:10 user nova-compute[74638]: node.session.timeo.replacement_timeout = 120
Nov 08 20:25:10 user nova-compute[74638]: node.session.err_timeo.abort_timeout = 15
Nov 08 20:25:10 user nova-compute[74638]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 20:25:10 user nova-compute[74638]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 20:25:10 user nova-compute[74638]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.FastAbort = Yes
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.InitialR2T = No
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.ImmediateData = Yes
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.MaxConnections = 1
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 20:25:10 user nova-compute[74638]: node.session.iscsi.ERL = 0
Nov 08 20:25:10 user nova-compute[74638]: node.session.scan = manual
Nov 08 20:25:10 user nova-compute[74638]: node.session.reopen_max = 0
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].address = 172.16.0.220
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].port = 3260
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].startup = manual
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].tcp.window_size = 524288
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].tcp.type_of_service = 0
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].timeo.logout_timeout = 15
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].timeo.login_timeout = 15
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].timeo.auth_timeout = 45
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].iscsi.DataDigest = None
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].iscsi.IFMarker = No
Nov 08 20:25:10 user nova-compute[74638]: node.conn[0].iscsi.OFMarker = No
Nov 08 20:25:10 user nova-compute[74638]: # END RECORD
Nov 08 20:25:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dd20dc-b3f7-4945-ad2e-bc6a60476b3f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5b363d-101b-4242-8374-79d38b70e37d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJvkzcIA {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJvkzcIA" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9118f1f-1637-477d-aeb1-0ec53e1e76c2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJvkzcIA'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f1696d-edac-4b95-8dc4-533cef4449a6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7aa128-163c-431a-af4b-c413ac2b7cc7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:25:11 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:25:11 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:25:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:25:11 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:25:11 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:25:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.209s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] HCTL ('33', '0', '0', 0) found on session 30 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[28989c4a-13e1-4a28-b348-d8a9f18e2593]: (4, ('0 0 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching for a device in session 30 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvkzcIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.247s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] <== connect_volume: return (249ms) {'type': 'block', 'scsi_wwn': '26637373339323134', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637373339323134', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1811673025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1811673025',id=28,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-ksxmvhpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:24:00Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=560f5d57-098f-49ce-b9be-cf5f3c091bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "vif_mac": "fa:16:3e:23:44:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "vif_mac": "fa:16:3e:23:44:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3ad67f50-983b-43e0-ada8-5da7b9d5ef28,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad67f50-98') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'pci_devices' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.objects.base [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<560f5d57-098f-49ce-b9be-cf5f3c091bb7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:25:11 user nova-compute[74638]:   <uuid>560f5d57-098f-49ce-b9be-cf5f3c091bb7</uuid>
Nov 08 20:25:11 user nova-compute[74638]:   <name>instance-0000001c</name>
Nov 08 20:25:11 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:25:11 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:25:11 user nova-compute[74638]:   <metadata>
Nov 08 20:25:11 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:25:11 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:25:11 user nova-compute[74638]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1811673025</nova:name>
Nov 08 20:25:11 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:25:10</nova:creationTime>
Nov 08 20:25:11 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:25:11 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:25:11 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:25:11 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:25:11 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:25:11 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:25:11 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:25:11 user nova-compute[74638]:       <nova:owner>
Nov 08 20:25:11 user nova-compute[74638]:         <nova:user uuid="9ab02946569c47ff9772753454afc5b3">tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member</nova:user>
Nov 08 20:25:11 user nova-compute[74638]:         <nova:project uuid="9d69c08c247c41cd842c3673cf9af390">tempest-ServerBootFromVolumeStableRescueTest-1821986023</nova:project>
Nov 08 20:25:11 user nova-compute[74638]:       </nova:owner>
Nov 08 20:25:11 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:25:11 user nova-compute[74638]:       <nova:ports>
Nov 08 20:25:11 user nova-compute[74638]:         <nova:port uuid="3ad67f50-983b-43e0-ada8-5da7b9d5ef28">
Nov 08 20:25:11 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 20:25:11 user nova-compute[74638]:         </nova:port>
Nov 08 20:25:11 user nova-compute[74638]:       </nova:ports>
Nov 08 20:25:11 user nova-compute[74638]:     </nova:instance>
Nov 08 20:25:11 user nova-compute[74638]:   </metadata>
Nov 08 20:25:11 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:25:11 user nova-compute[74638]:     <system>
Nov 08 20:25:11 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:25:11 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:25:11 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:25:11 user nova-compute[74638]:       <entry name="serial">560f5d57-098f-49ce-b9be-cf5f3c091bb7</entry>
Nov 08 20:25:11 user nova-compute[74638]:       <entry name="uuid">560f5d57-098f-49ce-b9be-cf5f3c091bb7</entry>
Nov 08 20:25:11 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:25:11 user nova-compute[74638]:     </system>
Nov 08 20:25:11 user nova-compute[74638]:   </sysinfo>
Nov 08 20:25:11 user nova-compute[74638]:   <os>
Nov 08 20:25:11 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:25:11 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:25:11 user nova-compute[74638]:   </os>
Nov 08 20:25:11 user nova-compute[74638]:   <features>
Nov 08 20:25:11 user nova-compute[74638]:     <acpi/>
Nov 08 20:25:11 user nova-compute[74638]:     <apic/>
Nov 08 20:25:11 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:25:11 user nova-compute[74638]:   </features>
Nov 08 20:25:11 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:25:11 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:25:11 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:25:11 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:25:11 user nova-compute[74638]:   </clock>
Nov 08 20:25:11 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:25:11 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:25:11 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:25:11 user nova-compute[74638]:   </cpu>
Nov 08 20:25:11 user nova-compute[74638]:   <devices>
Nov 08 20:25:11 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:25:11 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:25:11 user nova-compute[74638]:       <source dev="/dev/sdb"/>
Nov 08 20:25:11 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:25:11 user nova-compute[74638]:       <serial>fec11291-8f97-42b8-9527-d95f5c5ab64d</serial>
Nov 08 20:25:11 user nova-compute[74638]:     </disk>
Nov 08 20:25:11 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:25:11 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:25:11 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue"/>
Nov 08 20:25:11 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:25:11 user nova-compute[74638]:       <boot order="1"/>
Nov 08 20:25:11 user nova-compute[74638]:     </disk>
Nov 08 20:25:11 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:25:11 user nova-compute[74638]:       <mac address="fa:16:3e:23:44:e8"/>
Nov 08 20:25:11 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:25:11 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:25:11 user nova-compute[74638]:       <target dev="tap3ad67f50-98"/>
Nov 08 20:25:11 user nova-compute[74638]:     </interface>
Nov 08 20:25:11 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:25:11 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/console.log" append="off"/>
Nov 08 20:25:11 user nova-compute[74638]:     </serial>
Nov 08 20:25:11 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:25:11 user nova-compute[74638]:     <video>
Nov 08 20:25:11 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:25:11 user nova-compute[74638]:     </video>
Nov 08 20:25:11 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:25:11 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:25:11 user nova-compute[74638]:     </rng>
Nov 08 20:25:11 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:25:11 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:25:11 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:25:11 user nova-compute[74638]:     </memballoon>
Nov 08 20:25:11 user nova-compute[74638]:   </devices>
Nov 08 20:25:11 user nova-compute[74638]: </domain>
Nov 08 20:25:11 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:25:11 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance destroyed successfully.
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No VIF found with MAC fa:16:3e:23:44:e8, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-5b8a127d-5b6e-44a7-adaf-5cde3933fb79 req-1fad79fa-a756-4baa-9660-82588c69c143 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5b8a127d-5b6e-44a7-adaf-5cde3933fb79 req-1fad79fa-a756-4baa-9660-82588c69c143 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5b8a127d-5b6e-44a7-adaf-5cde3933fb79 req-1fad79fa-a756-4baa-9660-82588c69c143 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5b8a127d-5b6e-44a7-adaf-5cde3933fb79 req-1fad79fa-a756-4baa-9660-82588c69c143 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-5b8a127d-5b6e-44a7-adaf-5cde3933fb79 req-1fad79fa-a756-4baa-9660-82588c69c143 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:25:13 user nova-compute[74638]: WARNING nova.compute.manager [req-5b8a127d-5b6e-44a7-adaf-5cde3933fb79 req-1fad79fa-a756-4baa-9660-82588c69c143 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state active and task_state rescuing.
Nov 08 20:25:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-9fe0362f-d81a-43cc-8316-459f0ef0b19b req-ee9111b7-636c-4089-bc85-955df55e99a3 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9fe0362f-d81a-43cc-8316-459f0ef0b19b req-ee9111b7-636c-4089-bc85-955df55e99a3 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9fe0362f-d81a-43cc-8316-459f0ef0b19b req-ee9111b7-636c-4089-bc85-955df55e99a3 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9fe0362f-d81a-43cc-8316-459f0ef0b19b req-ee9111b7-636c-4089-bc85-955df55e99a3 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-9fe0362f-d81a-43cc-8316-459f0ef0b19b req-ee9111b7-636c-4089-bc85-955df55e99a3 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:25:15 user nova-compute[74638]: WARNING nova.compute.manager [req-9fe0362f-d81a-43cc-8316-459f0ef0b19b req-ee9111b7-636c-4089-bc85-955df55e99a3 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state active and task_state rescuing.
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-6671cb0e-6b69-488d-9476-1c1935d890b8 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:25:16 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:25:16 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7744MB free_disk=25.050399780273438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 491aafd0-a4dd-4cb2-9584-e88c39367878 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a7641b40-ef53-404c-9810-0e7c0e933681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0f9039b6-fc00-4956-ae26-a17f2886396b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:25:16 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:25:17 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:25:17 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:25:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:25:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:25:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:25:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ee13c85-4de7-4038-a2f8-aec70aa38b4f req-483618d0-f014-43d1-b339-af4442a8ee0e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received event network-changed-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ee13c85-4de7-4038-a2f8-aec70aa38b4f req-483618d0-f014-43d1-b339-af4442a8ee0e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Refreshing instance network info cache due to event network-changed-1840d14e-f577-43cc-97e7-ce187bf8fcdf. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ee13c85-4de7-4038-a2f8-aec70aa38b4f req-483618d0-f014-43d1-b339-af4442a8ee0e service nova] Acquiring lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ee13c85-4de7-4038-a2f8-aec70aa38b4f req-483618d0-f014-43d1-b339-af4442a8ee0e service nova] Acquired lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ee13c85-4de7-4038-a2f8-aec70aa38b4f req-483618d0-f014-43d1-b339-af4442a8ee0e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Refreshing network info cache for port 1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-de8f8ae4-1341-4934-893b-fe0d1d3706ae req-3e88bc84-10ae-40a5-b90c-9227e38ce470 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-changed-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-de8f8ae4-1341-4934-893b-fe0d1d3706ae req-3e88bc84-10ae-40a5-b90c-9227e38ce470 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Refreshing instance network info cache due to event network-changed-361e19ab-b526-4a96-9b9a-c7f671bf85be. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-de8f8ae4-1341-4934-893b-fe0d1d3706ae req-3e88bc84-10ae-40a5-b90c-9227e38ce470 service nova] Acquiring lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-de8f8ae4-1341-4934-893b-fe0d1d3706ae req-3e88bc84-10ae-40a5-b90c-9227e38ce470 service nova] Acquired lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.network.neutron [req-de8f8ae4-1341-4934-893b-fe0d1d3706ae req-3e88bc84-10ae-40a5-b90c-9227e38ce470 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Refreshing network info cache for port 361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ee13c85-4de7-4038-a2f8-aec70aa38b4f req-483618d0-f014-43d1-b339-af4442a8ee0e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updated VIF entry in instance network info cache for port 1840d14e-f577-43cc-97e7-ce187bf8fcdf. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ee13c85-4de7-4038-a2f8-aec70aa38b4f req-483618d0-f014-43d1-b339-af4442a8ee0e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updating instance_info_cache with network_info: [{"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ee13c85-4de7-4038-a2f8-aec70aa38b4f req-483618d0-f014-43d1-b339-af4442a8ee0e service nova] Releasing lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.objects.instance [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'flavor' on Instance uuid 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'flavor' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG nova.network.neutron [req-de8f8ae4-1341-4934-893b-fe0d1d3706ae req-3e88bc84-10ae-40a5-b90c-9227e38ce470 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updated VIF entry in instance network info cache for port 361e19ab-b526-4a96-9b9a-c7f671bf85be. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG nova.network.neutron [req-de8f8ae4-1341-4934-893b-fe0d1d3706ae req-3e88bc84-10ae-40a5-b90c-9227e38ce470 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating instance_info_cache with network_info: [{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:26 user nova-compute[74638]: INFO nova.compute.manager [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Attaching volume b85de407-a409-45a1-83b7-3cf437ca20c9 to /dev/vdb
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-de8f8ae4-1341-4934-893b-fe0d1d3706ae req-3e88bc84-10ae-40a5-b90c-9227e38ce470 service nova] Releasing lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:26 user nova-compute[74638]: INFO nova.compute.manager [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Attaching volume 1c798879-893e-426d-a40d-f83f94431e04 to /dev/vdb
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.utils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.utils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[007b2a47-f743-4486-b816-0510fb04bd70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0cd9c-c98f-49c3-bff8-1f509256c62a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff04977-810f-472c-aa8b-40b73721d481]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a5048c-95ea-4077-a87b-d660293bf3d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9aad86-d8a3-4c0c-af46-a1d1070e1756]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd0e8b9-c2b3-47a3-8445-adb3956dfac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1af44b2-fb3d-4bd7-b9c9-2dd7f0e88694]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[26db349e-cc00-42c9-8b03-2b215a3233f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:25:26 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ccc5da-fd90-42f8-b795-9f19c0730738]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.utils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updating existing volume attachment record: 73d8ef55-13ee-4fdb-adac-dda3df39c32b {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:25:26 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:25:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d746fe70-57dd-4b73-a4e9-ceba8fb9e965]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG os_brick.utils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:25:26 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating existing volume attachment record: 6821b405-63e5-4497-9817-18f7d37c3299 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:25:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:43 user nova-compute[74638]: INFO nova.compute.manager [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Terminating instance
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-1c3263a8-fc3d-4113-adf4-45cb965dae33 req-dde3d132-1b61-4e3a-9abe-f88dfba110f7 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-unplugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1c3263a8-fc3d-4113-adf4-45cb965dae33 req-dde3d132-1b61-4e3a-9abe-f88dfba110f7 service nova] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1c3263a8-fc3d-4113-adf4-45cb965dae33 req-dde3d132-1b61-4e3a-9abe-f88dfba110f7 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1c3263a8-fc3d-4113-adf4-45cb965dae33 req-dde3d132-1b61-4e3a-9abe-f88dfba110f7 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-1c3263a8-fc3d-4113-adf4-45cb965dae33 req-dde3d132-1b61-4e3a-9abe-f88dfba110f7 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] No waiting events found dispatching network-vif-unplugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-1c3263a8-fc3d-4113-adf4-45cb965dae33 req-dde3d132-1b61-4e3a-9abe-f88dfba110f7 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-unplugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Instance destroyed successfully.
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.objects.instance [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'resources' on Instance uuid 491aafd0-a4dd-4cb2-9584-e88c39367878 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-912749548',display_name='tempest-ServerActionsTestOtherA-server-912749548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-912749548',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-qrmph4tl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=491aafd0-a4dd-4cb2-9584-e88c39367878,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "address": "fa:16:3e:84:fe:6f", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1c9dd-a5", "ovs_interfaceid": "f0b1c9dd-a527-44b2-b88d-cf428bf72ba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_vif [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0b1c9dd-a5, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4f9f584-fc5a-4b39-b25f-c0c6d0ade02b) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:43 user nova-compute[74638]: INFO os_vif [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:fe:6f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1c9dd-a527-44b2-b88d-cf428bf72ba7,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1c9dd-a5')
Nov 08 20:25:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJThDUgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:25:43 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a73ebe-1734-4b67-aec1-73c43d0581b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:25:43 user nova-compute[74638]: No targets found.
Nov 08 20:25:43 user nova-compute[74638]: iSNS:
Nov 08 20:25:43 user nova-compute[74638]: No targets found.
Nov 08 20:25:43 user nova-compute[74638]: STATIC:
Nov 08 20:25:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5
Nov 08 20:25:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:25:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:25:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:25:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:25:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:25:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b
Nov 08 20:25:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:25:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:25:43 user nova-compute[74638]: FIRMWARE:
Nov 08 20:25:43 user nova-compute[74638]: No targets found.
Nov 08 20:25:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:25:43 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:25:43 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7704f2ff-5676-4320-8f11-cfbb3145795b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcacb8b-f4a0-425b-aab7-72de2133e239]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:25:43 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:25:43 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:25:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b (non-flash)
Nov 08 20:25:43 user nova-compute[74638]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:25:43 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:25:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3fc670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf6a7f9-3a76-464b-8bfa-e9f0992a8a70]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5916c8d2-cbe3-44b2-bc38-70e4562860a7]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c04e29-dae2-4593-9c4b-16f214fa4400]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:25:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec0b168-6bac-4b92-bad9-156d357311d1]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b9d574-d371-456e-aa35-61741223a409]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bb9603-ade1-44cd-8709-70b6415e00ce]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260]
Nov 08 20:25:44 user nova-compute[74638]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b, portal: 172.16.0.220,3260] successful.
Nov 08 20:25:44 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e7f9f1-0309-4a06-8485-93af26b5674b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6eef35-d367-4cbd-91f0-d94f1104eca1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] <== disconnect_volume: return (338ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:25:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Deleting instance files /opt/stack/data/nova/instances/491aafd0-a4dd-4cb2-9584-e88c39367878_del
Nov 08 20:25:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Deletion of /opt/stack/data/nova/instances/491aafd0-a4dd-4cb2-9584-e88c39367878_del complete
Nov 08 20:25:44 user nova-compute[74638]: INFO nova.compute.manager [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 20:25:44 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:25:44 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:25:45 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:25:45 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Took 0.84 seconds to deallocate network for instance.
Nov 08 20:25:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-e6e2ef9d-6ba2-4c0c-be9f-b05128a07f0f req-0be59e96-2af9-49d8-a6e0-9ce11bd00309 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-deleted-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-22ea2f97-f0b6-4a77-8514-3f0be9c22e87 req-40150e0a-06b3-4a8b-af17-918a7f1a53a5 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22ea2f97-f0b6-4a77-8514-3f0be9c22e87 req-40150e0a-06b3-4a8b-af17-918a7f1a53a5 service nova] Acquiring lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22ea2f97-f0b6-4a77-8514-3f0be9c22e87 req-40150e0a-06b3-4a8b-af17-918a7f1a53a5 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22ea2f97-f0b6-4a77-8514-3f0be9c22e87 req-40150e0a-06b3-4a8b-af17-918a7f1a53a5 service nova] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-22ea2f97-f0b6-4a77-8514-3f0be9c22e87 req-40150e0a-06b3-4a8b-af17-918a7f1a53a5 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] No waiting events found dispatching network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:25:45 user nova-compute[74638]: WARNING nova.compute.manager [req-22ea2f97-f0b6-4a77-8514-3f0be9c22e87 req-40150e0a-06b3-4a8b-af17-918a7f1a53a5 service nova] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Received unexpected event network-vif-plugged-f0b1c9dd-a527-44b2-b88d-cf428bf72ba7 for instance with vm_state active and task_state deleting.
Nov 08 20:25:46 user nova-compute[74638]: INFO nova.compute.manager [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Took 0.98 seconds to detach 1 volumes for instance.
Nov 08 20:25:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: 491aafd0-a4dd-4cb2-9584-e88c39367878] Deleting volume: 30e7f9f1-0309-4a06-8485-93af26b5674b {{(pid=74638) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 20:25:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:46 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:25:46 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:25:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:46 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Deleted allocations for instance 491aafd0-a4dd-4cb2-9584-e88c39367878
Nov 08 20:25:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-305de9a0-22a2-4640-a4b0-e23f8a3818e6 tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "491aafd0-a4dd-4cb2-9584-e88c39367878" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.844s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-2fbfc248-2208-4894-abb1-1d44a021f915 req-02ac154d-6267-42e2-9715-cc15081690ac service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received event network-changed-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-2fbfc248-2208-4894-abb1-1d44a021f915 req-02ac154d-6267-42e2-9715-cc15081690ac service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Refreshing instance network info cache due to event network-changed-56275862-8342-4215-94b1-e6a8ecb2a2be. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2fbfc248-2208-4894-abb1-1d44a021f915 req-02ac154d-6267-42e2-9715-cc15081690ac service nova] Acquiring lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2fbfc248-2208-4894-abb1-1d44a021f915 req-02ac154d-6267-42e2-9715-cc15081690ac service nova] Acquired lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG nova.network.neutron [req-2fbfc248-2208-4894-abb1-1d44a021f915 req-02ac154d-6267-42e2-9715-cc15081690ac service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Refreshing network info cache for port 56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'flavor' on Instance uuid a7641b40-ef53-404c-9810-0e7c0e933681 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:25:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Ignoring supplied device name: /dev/vdb
Nov 08 20:25:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG nova.network.neutron [req-2fbfc248-2208-4894-abb1-1d44a021f915 req-02ac154d-6267-42e2-9715-cc15081690ac service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Updated VIF entry in instance network info cache for port 56275862-8342-4215-94b1-e6a8ecb2a2be. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG nova.network.neutron [req-2fbfc248-2208-4894-abb1-1d44a021f915 req-02ac154d-6267-42e2-9715-cc15081690ac service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Updating instance_info_cache with network_info: [{"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:25:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:25:54 user nova-compute[74638]: INFO nova.compute.manager [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Attaching volume d27d343d-b9d8-49ed-8e75-344c09b067e1 to /dev/vdb
Nov 08 20:25:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2fbfc248-2208-4894-abb1-1d44a021f915 req-02ac154d-6267-42e2-9715-cc15081690ac service nova] Releasing lock "refresh_cache-a7641b40-ef53-404c-9810-0e7c0e933681" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG os_brick.utils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[872848ba-f5e5-45a9-bdd9-7d49a0e92322]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c57013e-b7e1-4910-ae74-c8755272b84d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da202b3-eb91-46e2-96e2-8549a18c40d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[465a2465-84da-411c-a1fb-73b9648a5190]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:25:55 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:25:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4f076-7d5d-43ef-8437-42b5b7d4e5b3]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG os_brick.utils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:25:55 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Updating existing volume attachment record: 457b88ab-e3da-4cbd-baff-d89cb8e1ac70 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:25:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:25:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:01 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:26:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:06 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:07 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:26:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:26:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:26:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updating instance_info_cache with network_info: [{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:26:12 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:26:12 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=25.033100128173828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a7641b40-ef53-404c-9810-0e7c0e933681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0f9039b6-fc00-4956-ae26-a17f2886396b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:26:12 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:26:13 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:26:13 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:26:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:26:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcCbzRvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:26:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:26:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:26:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:26:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:26:18 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:26:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1be719-0f1f-4aeb-b980-b6eaa9ed21be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:26:18 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aead2efb-c52d-409a-a13a-85f69982c68b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1] added
Nov 08 20:26:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba6579-c60c-4853-a85f-0791bef67df5]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d84294-02c4-42f2-9d9f-c1ea916c7af8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcCbzRvE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcCbzRvE" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0877d958-ebb0-471f-90fb-6c7673fc92c2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LcCbzRvE'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a22504-bb14-4fa4-bd2b-21ce52a9e302]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c4e80f-67af-473b-8d87-8923e9ec88e3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:19 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:19 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[df64b585-0455-48bb-8b57-f1f82719464d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1, portal: 172.16.0.220,3260]
Nov 08 20:26:19 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1, portal: 172.16.0.220,3260] successful.
Nov 08 20:26:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f73c5a-bf11-4066-9d2e-2f04d82daf30]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.070s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3813419-9971-4ac3-b240-a38bb4bc9e1b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:19 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:19 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:19 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:19 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0ca4da-677c-4745-bd93-2416a6e4b07e]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:26:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcCbzRvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:26:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:26:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23132613738333964', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:26:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132613738333964', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:26:20 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'flavor' on Instance uuid a7641b40-ef53-404c-9810-0e7c0e933681 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:26:20 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:26:20 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:26:20 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:26:20 user nova-compute[74638]:   <serial>d27d343d-b9d8-49ed-8e75-344c09b067e1</serial>
Nov 08 20:26:20 user nova-compute[74638]: </disk>
Nov 08 20:26:20 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:26:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:26:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:26:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] No VIF found with MAC fa:16:3e:13:6e:06, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:26:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e72f4a9-2bea-4d37-9587-cc434429bf1b tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.125s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:22 user nova-compute[74638]: INFO nova.compute.manager [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Detaching volume 5beee78f-0980-4417-89d7-d5ce71a67cb5
Nov 08 20:26:23 user nova-compute[74638]: INFO nova.virt.block_device [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Attempting to driver detach volume 5beee78f-0980-4417-89d7-d5ce71a67cb5 from mountpoint /dev/vdc
Nov 08 20:26:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Attempting to detach device vdc from instance 0f9039b6-fc00-4956-ae26-a17f2886396b from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:26:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:26:23 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:26:23 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:26:23 user nova-compute[74638]:   <target dev="vdc" bus="virtio"/>
Nov 08 20:26:23 user nova-compute[74638]:   <serial>5beee78f-0980-4417-89d7-d5ce71a67cb5</serial>
Nov 08 20:26:23 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 20:26:23 user nova-compute[74638]: </disk>
Nov 08 20:26:23 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:26:23 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully detached device vdc from instance 0f9039b6-fc00-4956-ae26-a17f2886396b from the persistent domain config.
Nov 08 20:26:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0f9039b6-fc00-4956-ae26-a17f2886396b from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:26:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:26:23 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:26:23 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:26:23 user nova-compute[74638]:   <target dev="vdc" bus="virtio"/>
Nov 08 20:26:23 user nova-compute[74638]:   <serial>5beee78f-0980-4417-89d7-d5ce71a67cb5</serial>
Nov 08 20:26:23 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 20:26:23 user nova-compute[74638]: </disk>
Nov 08 20:26:23 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:26:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:26:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMbyGXLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:26:28 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:26:28 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:26:28 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYHhkUDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:26:28 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f13bcb-35f1-4810-8d8f-c600c0e5d2e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:26:28 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb53e87-3ae2-4287-8bb7-a11ad46f40e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04] added
Nov 08 20:26:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207c7b2-19c7-4395-aead-91d74476e660]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a9446-2442-4de0-8b0a-8297963d2526]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMbyGXLx {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMbyGXLx" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eac5fd-f5ca-4e6b-bf6a-fa7a23cac871]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMbyGXLx'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[488f3f5e-1e02-487b-8a93-d55954833b57]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[07311d3b-f00f-46be-a830-d6d62def8494]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f113df-e5b1-4081-b14b-9a05d1ab2712]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04, portal: 172.16.0.220,3260]
Nov 08 20:26:28 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04, portal: 172.16.0.220,3260] successful.
Nov 08 20:26:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f343e29-ead2-4442-ab60-1a0822c283c6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[83753cba-8d5f-4faf-b54d-c0ca7aac4f80]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:28 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[165b2e66-ce6e-4b87-9b37-518ab9e1bffa]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:26:28 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMbyGXLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23833313332343764', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833313332343764', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.311s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:26:29 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:26:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:26:29 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'flavor' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb5cb76-4301-4098-b452-c6a778ff6f75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:26:29 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:26:29 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:26:29 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:26:29 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:26:29 user nova-compute[74638]:   <serial>1c798879-893e-426d-a40d-f83f94431e04</serial>
Nov 08 20:26:29 user nova-compute[74638]: </disk>
Nov 08 20:26:29 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bff401-5bb8-4d27-9727-f7f883e46534]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9] added
Nov 08 20:26:29 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[009ddcb0-caf4-413e-bc0b-932fc35d108d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1656f604-de0a-45bf-b3c4-2f1f9fce18ee]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYHhkUDW {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYHhkUDW" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19d4ec-05ac-4e3b-93e2-48f9a3404e55]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zYHhkUDW'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf079c3-d961-4d3f-8b8b-09931e91d085]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a5797-4974-42ee-84e7-06398198e67f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[86553e45-a479-499e-8ec6-454f2751061f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9, portal: 172.16.0.220,3260]
Nov 08 20:26:30 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9, portal: 172.16.0.220,3260] successful.
Nov 08 20:26:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c80a3-875e-48a0-ac8a-1b8da5dc4485]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f928ce32-1789-4ea8-86e1-a9b3d24efed0]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)
Nov 08 20:26:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[42463407-42f1-4370-b178-87125bd3e124]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No VIF found with MAC fa:16:3e:68:e7:8b, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:26:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9178c2e2-d0a5-475b-b02c-613c9c82a137 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 64.432s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYHhkUDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] <== connect_volume: return (2671ms) {'type': 'block', 'scsi_wwn': '23731393165306237', 'path': '/dev/sdf'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731393165306237', 'path': '/dev/sdf'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG nova.objects.instance [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'flavor' on Instance uuid 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:26:31 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:26:31 user nova-compute[74638]:   <source dev="/dev/sdf"/>
Nov 08 20:26:31 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:26:31 user nova-compute[74638]:   <serial>b85de407-a409-45a1-83b7-3cf437ca20c9</serial>
Nov 08 20:26:31 user nova-compute[74638]: </disk>
Nov 08 20:26:31 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] No VIF found with MAC fa:16:3e:e3:e6:2c, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:26:31 user nova-compute[74638]: INFO nova.compute.manager [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Rescuing
Nov 08 20:26:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquired lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:26:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-47282a11-a5fc-4a6a-b5a1-b6e12e41bdb0 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 65.792s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG nova.network.neutron [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating instance_info_cache with network_info: [{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Releasing lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-e8a60509-9269-49ba-bede-81f5f3d18317 req-0818a90a-57e6-4b4d-a85c-e7ee05830ae3 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e8a60509-9269-49ba-bede-81f5f3d18317 req-0818a90a-57e6-4b4d-a85c-e7ee05830ae3 service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e8a60509-9269-49ba-bede-81f5f3d18317 req-0818a90a-57e6-4b4d-a85c-e7ee05830ae3 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e8a60509-9269-49ba-bede-81f5f3d18317 req-0818a90a-57e6-4b4d-a85c-e7ee05830ae3 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-e8a60509-9269-49ba-bede-81f5f3d18317 req-0818a90a-57e6-4b4d-a85c-e7ee05830ae3 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:26:32 user nova-compute[74638]: WARNING nova.compute.manager [req-e8a60509-9269-49ba-bede-81f5f3d18317 req-0818a90a-57e6-4b4d-a85c-e7ee05830ae3 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state active and task_state rescuing.
Nov 08 20:26:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance destroyed successfully.
Nov 08 20:26:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Attempting rescue
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74638) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance directory exists: not creating {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 20:26:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Creating image(s)
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.021s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'trusted_certs' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:33 user nova-compute[74638]: INFO nova.compute.manager [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Detaching volume b85de407-a409-45a1-83b7-3cf437ca20c9
Nov 08 20:26:33 user nova-compute[74638]: INFO nova.virt.block_device [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Attempting to driver detach volume b85de407-a409-45a1-83b7-3cf437ca20c9 from mountpoint /dev/vdb
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Attempting to detach device vdb from instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:26:33 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:26:33 user nova-compute[74638]:   <source dev="/dev/sdf"/>
Nov 08 20:26:33 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:26:33 user nova-compute[74638]:   <serial>b85de407-a409-45a1-83b7-3cf437ca20c9</serial>
Nov 08 20:26:33 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:26:33 user nova-compute[74638]: </disk>
Nov 08 20:26:33 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:26:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Successfully detached device vdb from instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 from the persistent domain config.
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:26:33 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:26:33 user nova-compute[74638]:   <source dev="/dev/sdf"/>
Nov 08 20:26:33 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:26:33 user nova-compute[74638]:   <serial>b85de407-a409-45a1-83b7-3cf437ca20c9</serial>
Nov 08 20:26:33 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:26:33 user nova-compute[74638]: </disk>
Nov 08 20:26:33 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.208s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue" returned: 0 in 0.058s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'migration_context' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Start _get_guest_xml network_info=[{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:68:e7:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'resources' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'numa_topology' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:26:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:26:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-78861426',display_name='tempest-ServerRescueNegativeTestJSON-server-78861426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-78861426',id=30,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWLIDNo3A6iC+Rs/V6O8UzxDvXMxbYKelsm2BtuSlovWsQ1nFYlMl3Valso2ECcejx6npl201NCuZCHLJp5xQPV4/sOHn1Cwz36eiJMeZeyW4eReIjVN0Q1qOVkVHXEkQ==',key_name='tempest-keypair-1883717809',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-0ack4fjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='444c578cebff4167825165a737b5bb85',uuid=07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:68:e7:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "vif_mac": "fa:16:3e:68:e7:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:e7:8b,bridge_name='br-int',has_traffic_filtering=True,id=361e19ab-b526-4a96-9b9a-c7f671bf85be,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e19ab-b5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'pci_devices' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.objects.base [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Object Instance<07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:26:33 user nova-compute[74638]:   <uuid>07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca</uuid>
Nov 08 20:26:33 user nova-compute[74638]:   <name>instance-0000001e</name>
Nov 08 20:26:33 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:26:33 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:26:33 user nova-compute[74638]:   <metadata>
Nov 08 20:26:33 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:26:33 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:26:33 user nova-compute[74638]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-78861426</nova:name>
Nov 08 20:26:33 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:26:33</nova:creationTime>
Nov 08 20:26:33 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:26:33 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:26:33 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:26:33 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:26:33 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:26:33 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:26:33 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:26:33 user nova-compute[74638]:       <nova:owner>
Nov 08 20:26:33 user nova-compute[74638]:         <nova:user uuid="444c578cebff4167825165a737b5bb85">tempest-ServerRescueNegativeTestJSON-1603324862-project-member</nova:user>
Nov 08 20:26:33 user nova-compute[74638]:         <nova:project uuid="e5f133d71d494371b87181e746074d70">tempest-ServerRescueNegativeTestJSON-1603324862</nova:project>
Nov 08 20:26:33 user nova-compute[74638]:       </nova:owner>
Nov 08 20:26:33 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:26:33 user nova-compute[74638]:       <nova:ports>
Nov 08 20:26:33 user nova-compute[74638]:         <nova:port uuid="361e19ab-b526-4a96-9b9a-c7f671bf85be">
Nov 08 20:26:33 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 20:26:33 user nova-compute[74638]:         </nova:port>
Nov 08 20:26:33 user nova-compute[74638]:       </nova:ports>
Nov 08 20:26:33 user nova-compute[74638]:     </nova:instance>
Nov 08 20:26:33 user nova-compute[74638]:   </metadata>
Nov 08 20:26:33 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:26:33 user nova-compute[74638]:     <system>
Nov 08 20:26:33 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:26:33 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:26:33 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:26:33 user nova-compute[74638]:       <entry name="serial">07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca</entry>
Nov 08 20:26:33 user nova-compute[74638]:       <entry name="uuid">07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca</entry>
Nov 08 20:26:33 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:26:33 user nova-compute[74638]:     </system>
Nov 08 20:26:33 user nova-compute[74638]:   </sysinfo>
Nov 08 20:26:33 user nova-compute[74638]:   <os>
Nov 08 20:26:33 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:26:33 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:26:33 user nova-compute[74638]:   </os>
Nov 08 20:26:33 user nova-compute[74638]:   <features>
Nov 08 20:26:33 user nova-compute[74638]:     <acpi/>
Nov 08 20:26:33 user nova-compute[74638]:     <apic/>
Nov 08 20:26:33 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:26:33 user nova-compute[74638]:   </features>
Nov 08 20:26:33 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:26:33 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:26:33 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:26:33 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:26:33 user nova-compute[74638]:   </clock>
Nov 08 20:26:33 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:26:33 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:26:33 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:26:33 user nova-compute[74638]:   </cpu>
Nov 08 20:26:33 user nova-compute[74638]:   <devices>
Nov 08 20:26:33 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:26:33 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:26:33 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue"/>
Nov 08 20:26:33 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:26:33 user nova-compute[74638]:     </disk>
Nov 08 20:26:33 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:26:33 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:26:33 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk"/>
Nov 08 20:26:33 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:26:33 user nova-compute[74638]:     </disk>
Nov 08 20:26:33 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:26:33 user nova-compute[74638]:       <mac address="fa:16:3e:68:e7:8b"/>
Nov 08 20:26:33 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:26:33 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:26:33 user nova-compute[74638]:       <target dev="tap361e19ab-b5"/>
Nov 08 20:26:33 user nova-compute[74638]:     </interface>
Nov 08 20:26:33 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:26:33 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/console.log" append="off"/>
Nov 08 20:26:33 user nova-compute[74638]:     </serial>
Nov 08 20:26:33 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:26:33 user nova-compute[74638]:     <video>
Nov 08 20:26:33 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:26:33 user nova-compute[74638]:     </video>
Nov 08 20:26:33 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:26:33 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:26:33 user nova-compute[74638]:     </rng>
Nov 08 20:26:33 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:26:33 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:26:33 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:26:33 user nova-compute[74638]:     </memballoon>
Nov 08 20:26:33 user nova-compute[74638]:   </devices>
Nov 08 20:26:33 user nova-compute[74638]: </domain>
Nov 08 20:26:33 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:26:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance destroyed successfully.
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] No VIF found with MAC fa:16:3e:68:e7:8b, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:26:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-9e7b5aff-f8e8-4876-ab87-4640bbd7cec1 req-d20bc535-197c-41f6-b957-f2adee4a6e61 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:26:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9e7b5aff-f8e8-4876-ab87-4640bbd7cec1 req-d20bc535-197c-41f6-b957-f2adee4a6e61 service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9e7b5aff-f8e8-4876-ab87-4640bbd7cec1 req-d20bc535-197c-41f6-b957-f2adee4a6e61 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9e7b5aff-f8e8-4876-ab87-4640bbd7cec1 req-d20bc535-197c-41f6-b957-f2adee4a6e61 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-9e7b5aff-f8e8-4876-ab87-4640bbd7cec1 req-d20bc535-197c-41f6-b957-f2adee4a6e61 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:26:34 user nova-compute[74638]: WARNING nova.compute.manager [req-9e7b5aff-f8e8-4876-ab87-4640bbd7cec1 req-d20bc535-197c-41f6-b957-f2adee4a6e61 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state active and task_state rescuing.
Nov 08 20:26:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:26:36 user nova-compute[74638]: WARNING nova.compute.manager [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state active and task_state rescuing.
Nov 08 20:26:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:26:36 user nova-compute[74638]: WARNING nova.compute.manager [req-0ac75940-5f04-4027-a95a-56f283f36f0b req-88055ef6-d839-4f18-afab-a898cb0d331e service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state active and task_state rescuing.
Nov 08 20:26:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-282488c8-7d84-482a-84fb-f1a43d09f434 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:26:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:43 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0f9039b6-fc00-4956-ae26-a17f2886396b is timed out.
Nov 08 20:26:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully detached device vdc from instance 0f9039b6-fc00-4956-ae26-a17f2886396b from the live domain config.
Nov 08 20:26:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OXNxCiqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:26:43 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[294915c6-0990-47fc-952b-450c529b020a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:26:43 user nova-compute[74638]: No targets found.
Nov 08 20:26:43 user nova-compute[74638]: iSNS:
Nov 08 20:26:43 user nova-compute[74638]: No targets found.
Nov 08 20:26:43 user nova-compute[74638]: STATIC:
Nov 08 20:26:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5
Nov 08 20:26:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9
Nov 08 20:26:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:26:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1
Nov 08 20:26:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04
Nov 08 20:26:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:43 user nova-compute[74638]: FIRMWARE:
Nov 08 20:26:43 user nova-compute[74638]: No targets found.
Nov 08 20:26:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:26:43 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:26:43 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb38f9-b59b-4219-a59d-f5006c1db9ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[674d3d84-6c4e-44af-bc69-1401254d741d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:43 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:43 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:43 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:43 user nova-compute[74638]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)
Nov 08 20:26:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:43 user nova-compute[74638]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 (non-flash)
Nov 08 20:26:43 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:43 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:43 user nova-compute[74638]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)
Nov 08 20:26:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c012320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dfe439-5522-4fcf-8682-67d9e3286128]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab979106-c4be-40c8-b419-5ec6e99ad53f]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[53609ef9-e4b4-4fbf-87da-d9ab52e93b70]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad161cdf-6b8f-43bc-a62e-4c8a550ba941]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17f9252-a4cc-400f-804b-0f096b8709de]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd10de1-8dae-4e6f-baa2-12d9d27a1746]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5, portal: 172.16.0.220,3260]
Nov 08 20:26:43 user nova-compute[74638]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5, portal: 172.16.0.220,3260] successful.
Nov 08 20:26:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5beee78f-0980-4417-89d7-d5ce71a67cb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8058921-7d18-4831-980f-00076cef1599]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] <== disconnect_volume: return (350ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:26:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:45 user nova-compute[74638]: INFO nova.compute.manager [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Terminating instance
Nov 08 20:26:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-2f314006-b686-4289-8c59-257017e74835 req-c04db51b-15fd-4c7c-bdd6-10e03e6ad3ab service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-vif-unplugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2f314006-b686-4289-8c59-257017e74835 req-c04db51b-15fd-4c7c-bdd6-10e03e6ad3ab service nova] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2f314006-b686-4289-8c59-257017e74835 req-c04db51b-15fd-4c7c-bdd6-10e03e6ad3ab service nova] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2f314006-b686-4289-8c59-257017e74835 req-c04db51b-15fd-4c7c-bdd6-10e03e6ad3ab service nova] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-2f314006-b686-4289-8c59-257017e74835 req-c04db51b-15fd-4c7c-bdd6-10e03e6ad3ab service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] No waiting events found dispatching network-vif-unplugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-2f314006-b686-4289-8c59-257017e74835 req-c04db51b-15fd-4c7c-bdd6-10e03e6ad3ab service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-vif-unplugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:26:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Instance destroyed successfully.
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lazy-loading 'resources' on Instance uuid e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-555026932',display_name='tempest-ServerActionsTestOtherA-server-555026932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-555026932',id=5,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1kH6uI+w6sQwG+vXa+HcFoMnCxw1eoBLGrjplrMmQuZ8vMTkMRahLhswgJefy2pwRbx03CZshyLDLeZ5DTf7AsTyR4dIfa4TbFr/G71GoSdL2oy0rxMRC5vmoUrL7mg==',key_name='tempest-keypair-343542597',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0b2492206349f197739ee10c95a28f',ramdisk_id='',reservation_id='r-3vp46ot3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1281886616',owner_user_name='tempest-ServerActionsTestOtherA-1281886616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc302495f45a4ae1bd2524aa60ecbc85',uuid=e13e6fa8-4eac-4077-ba81-b107a1f9bfe0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converting VIF {"id": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "address": "fa:16:3e:6f:c0:81", "network": {"id": "c4fe1004-0157-4573-b127-79cdde900c16", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-704165763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0b2492206349f197739ee10c95a28f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0448bd-7d", "ovs_interfaceid": "fe0448bd-7de8-4903-85a8-e9e452f2fec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=fe0448bd-7de8-4903-85a8-e9e452f2fec2,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0448bd-7d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG os_vif [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=fe0448bd-7de8-4903-85a8-e9e452f2fec2,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0448bd-7d') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe0448bd-7d, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c60aab7c-f77f-41e6-a307-627bd008cd6b) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:26:46 user nova-compute[74638]: INFO os_vif [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:c0:81,bridge_name='br-int',has_traffic_filtering=True,id=fe0448bd-7de8-4903-85a8-e9e452f2fec2,network=Network(c4fe1004-0157-4573-b127-79cdde900c16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0448bd-7d')
Nov 08 20:26:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Deleting instance files /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0_del
Nov 08 20:26:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Deletion of /opt/stack/data/nova/instances/e13e6fa8-4eac-4077-ba81-b107a1f9bfe0_del complete
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'flavor' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d2094d7d-0ba7-4af2-937e-a91efb0c5398 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.510s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:46 user nova-compute[74638]: INFO nova.compute.manager [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 08 20:26:46 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:26:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:26:47 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Took 0.59 seconds to deallocate network for instance.
Nov 08 20:26:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-ea7da960-ca17-48b2-89eb-75d0d5863af6 req-d30fe020-d157-4f8d-b0b7-efd91257f72e service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-vif-deleted-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:26:47 user nova-compute[74638]: INFO nova.compute.manager [req-ea7da960-ca17-48b2-89eb-75d0d5863af6 req-d30fe020-d157-4f8d-b0b7-efd91257f72e service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Neutron deleted interface fe0448bd-7de8-4903-85a8-e9e452f2fec2; detaching it from the instance and deleting it from the info cache
Nov 08 20:26:47 user nova-compute[74638]: DEBUG nova.network.neutron [req-ea7da960-ca17-48b2-89eb-75d0d5863af6 req-d30fe020-d157-4f8d-b0b7-efd91257f72e service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:26:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-ea7da960-ca17-48b2-89eb-75d0d5863af6 req-d30fe020-d157-4f8d-b0b7-efd91257f72e service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Detach interface failed, port_id=fe0448bd-7de8-4903-85a8-e9e452f2fec2, reason: Instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:26:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:47 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:26:47 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:26:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:47 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Deleted allocations for instance e13e6fa8-4eac-4077-ba81-b107a1f9bfe0
Nov 08 20:26:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53baf27a-21e0-4db9-9de0-00db7a4181ff tempest-ServerActionsTestOtherA-1281886616 tempest-ServerActionsTestOtherA-1281886616-project-member] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-ebd23dab-eace-4003-b857-6839e7a2e485 req-71f9121d-aaad-4dc7-82af-53f3659dd337 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received event network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:26:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ebd23dab-eace-4003-b857-6839e7a2e485 req-71f9121d-aaad-4dc7-82af-53f3659dd337 service nova] Acquiring lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ebd23dab-eace-4003-b857-6839e7a2e485 req-71f9121d-aaad-4dc7-82af-53f3659dd337 service nova] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ebd23dab-eace-4003-b857-6839e7a2e485 req-71f9121d-aaad-4dc7-82af-53f3659dd337 service nova] Lock "e13e6fa8-4eac-4077-ba81-b107a1f9bfe0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-ebd23dab-eace-4003-b857-6839e7a2e485 req-71f9121d-aaad-4dc7-82af-53f3659dd337 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] No waiting events found dispatching network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:26:48 user nova-compute[74638]: WARNING nova.compute.manager [req-ebd23dab-eace-4003-b857-6839e7a2e485 req-71f9121d-aaad-4dc7-82af-53f3659dd337 service nova] [instance: e13e6fa8-4eac-4077-ba81-b107a1f9bfe0] Received unexpected event network-vif-plugged-fe0448bd-7de8-4903-85a8-e9e452f2fec2 for instance with vm_state deleted and task_state None.
Nov 08 20:26:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:53 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 is timed out.
Nov 08 20:26:53 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Successfully detached device vdb from instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 from the live domain config.
Nov 08 20:26:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYHhkUDW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:26:53 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:26:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[32da7cab-c850-4a9a-8a49-fe46f3e580a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:26:53 user nova-compute[74638]: No targets found.
Nov 08 20:26:53 user nova-compute[74638]: iSNS:
Nov 08 20:26:53 user nova-compute[74638]: No targets found.
Nov 08 20:26:53 user nova-compute[74638]: STATIC:
Nov 08 20:26:53 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9
Nov 08 20:26:53 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:53 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:53 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:26:53 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:53 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:53 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1
Nov 08 20:26:53 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:53 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:53 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04
Nov 08 20:26:53 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:26:53 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:26:53 user nova-compute[74638]: FIRMWARE:
Nov 08 20:26:53 user nova-compute[74638]: No targets found.
Nov 08 20:26:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:26:53 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:26:53 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:26:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e930f7-3013-4acf-af6d-9cb929a1007a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3245b6-c5e7-45e8-a078-0c6621237897]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:54 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:54 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:54 user nova-compute[74638]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)
Nov 08 20:26:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:26:54 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:26:54 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:26:54 user nova-compute[74638]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 (non-flash)
Nov 08 20:26:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c18ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9'): ({'sdf'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Removing single pathed devices sdf {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[53db4cc6-0af7-47f3-a169-6e2808a9343a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb68fd8-9ddb-45e8-b892-1019709e1c52]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Flushing IO for device /dev/sdf {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f7714-25e8-4025-9510-86a09fbbefe1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f3edf5-c2a9-4919-803e-5aa8deeeed7c]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] SCSI volumes sdf have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ee56d8-b42a-45ae-a5e8-16fdb3603ed0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc2b5c-3b04-4917-b343-36371395f630]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9, portal: 172.16.0.220,3260]
Nov 08 20:26:54 user nova-compute[74638]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9, portal: 172.16.0.220,3260] successful.
Nov 08 20:26:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b85de407-a409-45a1-83b7-3cf437ca20c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e99c00-602b-4d60-a885-fcde22142159]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] <== disconnect_volume: return (337ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:26:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:26:55 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'flavor' on Instance uuid 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8c6e8018-1e75-44d5-9866-6e4d643d0c55 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.113s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:58 user nova-compute[74638]: INFO nova.compute.manager [None req-6dea93ca-f31b-4b26-9261-cb2bd31e827e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Unrescuing
Nov 08 20:26:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dea93ca-f31b-4b26-9261-cb2bd31e827e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:26:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dea93ca-f31b-4b26-9261-cb2bd31e827e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquired lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:26:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-6dea93ca-f31b-4b26-9261-cb2bd31e827e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:26:58 user nova-compute[74638]: DEBUG nova.network.neutron [None req-6dea93ca-f31b-4b26-9261-cb2bd31e827e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating instance_info_cache with network_info: [{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:26:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dea93ca-f31b-4b26-9261-cb2bd31e827e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Releasing lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:26:58 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6dea93ca-f31b-4b26-9261-cb2bd31e827e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'flavor' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:26:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:59 user nova-compute[74638]: DEBUG nova.compute.manager [req-20f74542-7ddb-435d-bb81-affaff925cb5 req-ebaffdde-43a1-4bdd-b6ad-f283b557fcd2 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:26:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-20f74542-7ddb-435d-bb81-affaff925cb5 req-ebaffdde-43a1-4bdd-b6ad-f283b557fcd2 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:26:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-20f74542-7ddb-435d-bb81-affaff925cb5 req-ebaffdde-43a1-4bdd-b6ad-f283b557fcd2 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:26:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-20f74542-7ddb-435d-bb81-affaff925cb5 req-ebaffdde-43a1-4bdd-b6ad-f283b557fcd2 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:26:59 user nova-compute[74638]: DEBUG nova.compute.manager [req-20f74542-7ddb-435d-bb81-affaff925cb5 req-ebaffdde-43a1-4bdd-b6ad-f283b557fcd2 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:26:59 user nova-compute[74638]: WARNING nova.compute.manager [req-20f74542-7ddb-435d-bb81-affaff925cb5 req-ebaffdde-43a1-4bdd-b6ad-f283b557fcd2 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:26:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:26:59 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:26:59 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance destroyed successfully.
Nov 08 20:27:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:01 user nova-compute[74638]: DEBUG nova.compute.manager [req-b7b24b3b-5d00-4922-b849-37c67db23840 req-92ac2fee-2c29-4a82-beee-e5668dac3bed service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b7b24b3b-5d00-4922-b849-37c67db23840 req-92ac2fee-2c29-4a82-beee-e5668dac3bed service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b7b24b3b-5d00-4922-b849-37c67db23840 req-92ac2fee-2c29-4a82-beee-e5668dac3bed service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b7b24b3b-5d00-4922-b849-37c67db23840 req-92ac2fee-2c29-4a82-beee-e5668dac3bed service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:01 user nova-compute[74638]: DEBUG nova.compute.manager [req-b7b24b3b-5d00-4922-b849-37c67db23840 req-92ac2fee-2c29-4a82-beee-e5668dac3bed service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:01 user nova-compute[74638]: WARNING nova.compute.manager [req-b7b24b3b-5d00-4922-b849-37c67db23840 req-92ac2fee-2c29-4a82-beee-e5668dac3bed service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:27:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:01 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-6dea93ca-f31b-4b26-9261-cb2bd31e827e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:03 user nova-compute[74638]: WARNING nova.compute.manager [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state active and task_state None.
Nov 08 20:27:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:03 user nova-compute[74638]: WARNING nova.compute.manager [req-2815e0d8-213e-4c96-917a-050bdd4eb103 req-0861556b-93c7-4128-bf94-ed5a28ae14c0 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state active and task_state None.
Nov 08 20:27:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:05 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:27:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:07 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:07 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:27:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:27:07 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:27:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:08 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:27:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:27:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:27:08 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updating instance_info_cache with network_info: [{"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-9f955212-6cf6-4f51-944a-5a3482082fda" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:09 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:27:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:13 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:27:13 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7969MB free_disk=25.05783462524414GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:13 user nova-compute[74638]: INFO nova.compute.manager [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Terminating instance
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-93346c87-356c-4909-b3bf-573799b4b838 req-7f15f7cc-f62a-4ace-ae2b-d96350ba07c9 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-unplugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-93346c87-356c-4909-b3bf-573799b4b838 req-7f15f7cc-f62a-4ace-ae2b-d96350ba07c9 service nova] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-93346c87-356c-4909-b3bf-573799b4b838 req-7f15f7cc-f62a-4ace-ae2b-d96350ba07c9 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-93346c87-356c-4909-b3bf-573799b4b838 req-7f15f7cc-f62a-4ace-ae2b-d96350ba07c9 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-93346c87-356c-4909-b3bf-573799b4b838 req-7f15f7cc-f62a-4ace-ae2b-d96350ba07c9 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] No waiting events found dispatching network-vif-unplugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-93346c87-356c-4909-b3bf-573799b4b838 req-7f15f7cc-f62a-4ace-ae2b-d96350ba07c9 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-unplugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a7641b40-ef53-404c-9810-0e7c0e933681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0f9039b6-fc00-4956-ae26-a17f2886396b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:27:13 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:27:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Instance destroyed successfully.
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'resources' on Instance uuid 0f9039b6-fc00-4956-ae26-a17f2886396b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1143454668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1143454668',id=26,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxzJ3KE50iQM0jwOCqCh4KQ/vzvRLl3tq/Ll6Ya0m8Ck/8f7/E3zGEiJKYPkSMgfZEV3PMQ7ob8StvEtDmGIaaKNNWNtdYc7UPFX2IyOl8478nhJBji0kZciyJQhhiUJg==',key_name='tempest-keypair-1222414860',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-15l2jril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=0f9039b6-fc00-4956-ae26-a17f2886396b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "address": "fa:16:3e:e8:d2:87", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0355f8aa-41", "ovs_interfaceid": "0355f8aa-41f3-4cd9-8c77-e0daf1a9959e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG os_vif [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.825s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0355f8aa-41, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e231d69-3d62-451e-aed8-2d0dc8d83379) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:14 user nova-compute[74638]: INFO os_vif [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d2:87,bridge_name='br-int',has_traffic_filtering=True,id=0355f8aa-41f3-4cd9-8c77-e0daf1a9959e,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0355f8aa-41')
Nov 08 20:27:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Deleting instance files /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b_del
Nov 08 20:27:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Deletion of /opt/stack/data/nova/instances/0f9039b6-fc00-4956-ae26-a17f2886396b_del complete
Nov 08 20:27:14 user nova-compute[74638]: INFO nova.compute.manager [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 20:27:14 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:27:14 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:27:15 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Took 0.81 seconds to deallocate network for instance.
Nov 08 20:27:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-02bc537e-f5f8-445a-a5e5-c6e083d83e12 req-97e8ddb4-bdfa-4443-94e2-85f7018fde15 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-deleted-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:15 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Deleted allocations for instance 0f9039b6-fc00-4956-ae26-a17f2886396b
Nov 08 20:27:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ea212fff-90a4-49f6-90ef-077afbdf130b tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.223s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-642147bf-1bf2-455f-a172-711ce936abfb req-1e851e4d-8f0b-401d-9d76-c2e4fc693712 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-642147bf-1bf2-455f-a172-711ce936abfb req-1e851e4d-8f0b-401d-9d76-c2e4fc693712 service nova] Acquiring lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-642147bf-1bf2-455f-a172-711ce936abfb req-1e851e4d-8f0b-401d-9d76-c2e4fc693712 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-642147bf-1bf2-455f-a172-711ce936abfb req-1e851e4d-8f0b-401d-9d76-c2e4fc693712 service nova] Lock "0f9039b6-fc00-4956-ae26-a17f2886396b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-642147bf-1bf2-455f-a172-711ce936abfb req-1e851e4d-8f0b-401d-9d76-c2e4fc693712 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] No waiting events found dispatching network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:15 user nova-compute[74638]: WARNING nova.compute.manager [req-642147bf-1bf2-455f-a172-711ce936abfb req-1e851e4d-8f0b-401d-9d76-c2e4fc693712 service nova] [instance: 0f9039b6-fc00-4956-ae26-a17f2886396b] Received unexpected event network-vif-plugged-0355f8aa-41f3-4cd9-8c77-e0daf1a9959e for instance with vm_state deleted and task_state None.
Nov 08 20:27:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:27:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:22 user nova-compute[74638]: INFO nova.compute.manager [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Detaching volume d27d343d-b9d8-49ed-8e75-344c09b067e1
Nov 08 20:27:22 user nova-compute[74638]: INFO nova.virt.block_device [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Attempting to driver detach volume d27d343d-b9d8-49ed-8e75-344c09b067e1 from mountpoint /dev/vdb
Nov 08 20:27:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Attempting to detach device vdb from instance a7641b40-ef53-404c-9810-0e7c0e933681 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:27:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:27:22 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:27:22 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:27:22 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:27:22 user nova-compute[74638]:   <serial>d27d343d-b9d8-49ed-8e75-344c09b067e1</serial>
Nov 08 20:27:22 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:27:22 user nova-compute[74638]: </disk>
Nov 08 20:27:22 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:27:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:22 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Successfully detached device vdb from instance a7641b40-ef53-404c-9810-0e7c0e933681 from the persistent domain config.
Nov 08 20:27:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7641b40-ef53-404c-9810-0e7c0e933681 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:27:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:27:22 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:27:22 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:27:22 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:27:22 user nova-compute[74638]:   <serial>d27d343d-b9d8-49ed-8e75-344c09b067e1</serial>
Nov 08 20:27:22 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:27:22 user nova-compute[74638]: </disk>
Nov 08 20:27:22 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:27:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7641b40-ef53-404c-9810-0e7c0e933681 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-67b986a8-b818-45c7-89ad-6959c09f6828 req-c891405f-b9c9-45c8-aa98-8b8840a42925 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received event network-changed-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-67b986a8-b818-45c7-89ad-6959c09f6828 req-c891405f-b9c9-45c8-aa98-8b8840a42925 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Refreshing instance network info cache due to event network-changed-1840d14e-f577-43cc-97e7-ce187bf8fcdf. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-67b986a8-b818-45c7-89ad-6959c09f6828 req-c891405f-b9c9-45c8-aa98-8b8840a42925 service nova] Acquiring lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-67b986a8-b818-45c7-89ad-6959c09f6828 req-c891405f-b9c9-45c8-aa98-8b8840a42925 service nova] Acquired lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-67b986a8-b818-45c7-89ad-6959c09f6828 req-c891405f-b9c9-45c8-aa98-8b8840a42925 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Refreshing network info cache for port 1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:24 user nova-compute[74638]: INFO nova.compute.manager [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Terminating instance
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-67b986a8-b818-45c7-89ad-6959c09f6828 req-c891405f-b9c9-45c8-aa98-8b8840a42925 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updated VIF entry in instance network info cache for port 1840d14e-f577-43cc-97e7-ce187bf8fcdf. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-67b986a8-b818-45c7-89ad-6959c09f6828 req-c891405f-b9c9-45c8-aa98-8b8840a42925 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updating instance_info_cache with network_info: [{"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-67b986a8-b818-45c7-89ad-6959c09f6828 req-c891405f-b9c9-45c8-aa98-8b8840a42925 service nova] Releasing lock "refresh_cache-536f5a6a-02f3-43bc-a66a-edf45a9f98c8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:27:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Instance destroyed successfully.
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.objects.instance [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'resources' on Instance uuid 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-771820820',display_name='tempest-TestStampPattern-server-771820820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-771820820',id=29,image_ref='6b69ce39-0fee-4a43-814d-b0b622c87432',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxvPfR3m68mdARrbfav97jTy/o6OtKTjWJzrXNp0gr/QQk683HsyF983f34HQBJajTLCCF+GqbGWDF/11evWSydJuVmWuB9oczkR7bNKj4AYdUUQAWpsJK386HZ1lIOpA==',key_name='tempest-TestStampPattern-1081975694',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1466c6af77ed4c838f917c826e4c3594',ramdisk_id='',reservation_id='r-0imms99s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0e529715-d390-4929-998f-5835de148256',image_min_disk='1',image_min_ram='0',image_owner_id='1466c6af77ed4c838f917c826e4c3594',image_owner_project_name='tempest-TestStampPattern-248486380',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-248486380-project-member',image_user_id='5b93d3cfa1354826ab6ff1efbe49f46d',owner_project_name='tempest-TestStampPattern-248486380',owner_user_name='tempest-TestStampPattern-248486380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:23:41Z,user_data=None,user_id='5b93d3cfa1354826ab6ff1efbe49f46d',uuid=536f5a6a-02f3-43bc-a66a-edf45a9f98c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converting VIF {"id": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "address": "fa:16:3e:e3:e6:2c", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1840d14e-f5", "ovs_interfaceid": "1840d14e-f577-43cc-97e7-ce187bf8fcdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e6:2c,bridge_name='br-int',has_traffic_filtering=True,id=1840d14e-f577-43cc-97e7-ce187bf8fcdf,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1840d14e-f5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG os_vif [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e6:2c,bridge_name='br-int',has_traffic_filtering=True,id=1840d14e-f577-43cc-97e7-ce187bf8fcdf,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1840d14e-f5') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1840d14e-f5, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=699f8454-c5d9-4049-b8a5-be4ff4b2225b) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:27:24 user nova-compute[74638]: INFO os_vif [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:e6:2c,bridge_name='br-int',has_traffic_filtering=True,id=1840d14e-f577-43cc-97e7-ce187bf8fcdf,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1840d14e-f5')
Nov 08 20:27:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Deleting instance files /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8_del
Nov 08 20:27:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Deletion of /opt/stack/data/nova/instances/536f5a6a-02f3-43bc-a66a-edf45a9f98c8_del complete
Nov 08 20:27:25 user nova-compute[74638]: INFO nova.compute.manager [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 20:27:25 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:27:25 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Took 0.46 seconds to deallocate network for instance.
Nov 08 20:27:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ceacbca-e4c0-42e9-a92f-35265fe1df12 req-27142424-5554-417f-ba0b-c4632297e973 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received event network-vif-deleted-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:25 user nova-compute[74638]: INFO nova.compute.manager [req-1ceacbca-e4c0-42e9-a92f-35265fe1df12 req-27142424-5554-417f-ba0b-c4632297e973 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Neutron deleted interface 1840d14e-f577-43cc-97e7-ce187bf8fcdf; detaching it from the instance and deleting it from the info cache
Nov 08 20:27:25 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ceacbca-e4c0-42e9-a92f-35265fe1df12 req-27142424-5554-417f-ba0b-c4632297e973 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ceacbca-e4c0-42e9-a92f-35265fe1df12 req-27142424-5554-417f-ba0b-c4632297e973 service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Detach interface failed, port_id=1840d14e-f577-43cc-97e7-ce187bf8fcdf, reason: Instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:27:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:25 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Deleted allocations for instance 536f5a6a-02f3-43bc-a66a-edf45a9f98c8
Nov 08 20:27:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-40e99126-5286-464b-84db-7ad9e64d68b9 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received event network-vif-unplugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] No waiting events found dispatching network-vif-unplugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:26 user nova-compute[74638]: WARNING nova.compute.manager [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received unexpected event network-vif-unplugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf for instance with vm_state deleted and task_state None.
Nov 08 20:27:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received event network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] Acquiring lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] Lock "536f5a6a-02f3-43bc-a66a-edf45a9f98c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:26 user nova-compute[74638]: DEBUG nova.compute.manager [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] No waiting events found dispatching network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:26 user nova-compute[74638]: WARNING nova.compute.manager [req-53208b45-07d2-4707-b4ec-3be719dc4b76 req-f6e7aad2-119a-4c0a-882d-bbd5b762f84e service nova] [instance: 536f5a6a-02f3-43bc-a66a-edf45a9f98c8] Received unexpected event network-vif-plugged-1840d14e-f577-43cc-97e7-ce187bf8fcdf for instance with vm_state deleted and task_state None.
Nov 08 20:27:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:43 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a7641b40-ef53-404c-9810-0e7c0e933681 is timed out.
Nov 08 20:27:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Successfully detached device vdb from instance a7641b40-ef53-404c-9810-0e7c0e933681 from the live domain config.
Nov 08 20:27:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcCbzRvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:27:43 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c52045b-11ed-4860-92b9-740bc1a511d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:27:43 user nova-compute[74638]: No targets found.
Nov 08 20:27:43 user nova-compute[74638]: iSNS:
Nov 08 20:27:43 user nova-compute[74638]: No targets found.
Nov 08 20:27:43 user nova-compute[74638]: STATIC:
Nov 08 20:27:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:27:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:27:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:27:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1
Nov 08 20:27:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:27:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:27:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04
Nov 08 20:27:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:27:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:27:43 user nova-compute[74638]: FIRMWARE:
Nov 08 20:27:43 user nova-compute[74638]: No targets found.
Nov 08 20:27:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:27:43 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:27:43 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ece8a41-fe09-4883-8d18-563b0957a034]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e0af50-7aa3-4914-b817-d3b51e4e4c45]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:27:43 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:27:43 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:27:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:27:43 user nova-compute[74638]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 (non-flash)
Nov 08 20:27:43 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:27:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3fcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f274ffc-3ec9-4ea3-9e14-0cf02a9b8552]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b68b7a-fa59-411c-ab96-50449f09d875]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a077b09-c361-4204-9495-45da92841db7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3589d332-4615-48c5-9680-7e08646071e1]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b38de2-11a9-4806-a8bd-96d5680cef5a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[076011ea-c231-498d-8e1d-861065146187]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1, portal: 172.16.0.220,3260]
Nov 08 20:27:43 user nova-compute[74638]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1, portal: 172.16.0.220,3260] successful.
Nov 08 20:27:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab452dec-c2bc-4649-a808-62d28a76e43d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] <== disconnect_volume: return (334ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:27:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:27:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'flavor' on Instance uuid a7641b40-ef53-404c-9810-0e7c0e933681 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d7926359-55ce-4151-886c-16cc749c3aa7 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.380s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.271s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:45 user nova-compute[74638]: INFO nova.compute.manager [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Terminating instance
Nov 08 20:27:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-48c03d60-7fab-4c5a-b402-1042b2300211 req-932a3f1b-5417-4d34-b80c-fed71017bbab service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received event network-vif-unplugged-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-48c03d60-7fab-4c5a-b402-1042b2300211 req-932a3f1b-5417-4d34-b80c-fed71017bbab service nova] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-48c03d60-7fab-4c5a-b402-1042b2300211 req-932a3f1b-5417-4d34-b80c-fed71017bbab service nova] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-48c03d60-7fab-4c5a-b402-1042b2300211 req-932a3f1b-5417-4d34-b80c-fed71017bbab service nova] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-48c03d60-7fab-4c5a-b402-1042b2300211 req-932a3f1b-5417-4d34-b80c-fed71017bbab service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] No waiting events found dispatching network-vif-unplugged-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-48c03d60-7fab-4c5a-b402-1042b2300211 req-932a3f1b-5417-4d34-b80c-fed71017bbab service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received event network-vif-unplugged-56275862-8342-4215-94b1-e6a8ecb2a2be for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:27:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Instance destroyed successfully.
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lazy-loading 'resources' on Instance uuid a7641b40-ef53-404c-9810-0e7c0e933681 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1993136005',display_name='tempest-VolumesSnapshotTestJSON-instance-1993136005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1993136005',id=31,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKTOisfJhCcBcTcrsUiif69kGEPj92H8Ku9QBD3wcSxc5b7j7jcGZeLGHI+2k0MBFgOqujm3jfp5YPt3K/RC31vz+ymwIPax4gty4FAKYm1nXMtjEUEx5oxTdQ4IltpvA==',key_name='tempest-keypair-1676801169',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:24:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6a945ba0f2d41aa9cd7ad8dfd3ea0a3',ramdisk_id='',reservation_id='r-xryuaauz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1022894138',owner_user_name='tempest-VolumesSnapshotTestJSON-1022894138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:24:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='875fdd7768654b8e8c261749bbb1c78e',uuid=a7641b40-ef53-404c-9810-0e7c0e933681,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converting VIF {"id": "56275862-8342-4215-94b1-e6a8ecb2a2be", "address": "fa:16:3e:13:6e:06", "network": {"id": "be13f666-a7b2-4916-af7f-670345ef6969", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1446122795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6a945ba0f2d41aa9cd7ad8dfd3ea0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56275862-83", "ovs_interfaceid": "56275862-8342-4215-94b1-e6a8ecb2a2be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=56275862-8342-4215-94b1-e6a8ecb2a2be,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56275862-83') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_vif [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=56275862-8342-4215-94b1-e6a8ecb2a2be,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56275862-83') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56275862-83, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41294de1-115b-49fd-8772-34f2a23ef2ab) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:46 user nova-compute[74638]: INFO os_vif [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:6e:06,bridge_name='br-int',has_traffic_filtering=True,id=56275862-8342-4215-94b1-e6a8ecb2a2be,network=Network(be13f666-a7b2-4916-af7f-670345ef6969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56275862-83')
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcCbzRvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:27:46 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eefd86-5771-4099-94f7-787c48017df1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:27:46 user nova-compute[74638]: No targets found.
Nov 08 20:27:46 user nova-compute[74638]: iSNS:
Nov 08 20:27:46 user nova-compute[74638]: No targets found.
Nov 08 20:27:46 user nova-compute[74638]: STATIC:
Nov 08 20:27:46 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:27:46 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:27:46 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:27:46 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04
Nov 08 20:27:46 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:27:46 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:27:46 user nova-compute[74638]: FIRMWARE:
Nov 08 20:27:46 user nova-compute[74638]: No targets found.
Nov 08 20:27:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:27:46 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:27:46 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d27d343d-b9d8-49ed-8e75-344c09b067e1', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a7842d-596f-4943-8eee-ce07d16f8509]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c48d6a-032f-4f53-af0e-1c587c21194f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:27:46 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:27:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:27:46 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:27:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c23e0e0>, {}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Disconnecting from: [] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] <== disconnect_volume: return (69ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:27:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Deleting instance files /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681_del
Nov 08 20:27:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Deletion of /opt/stack/data/nova/instances/a7641b40-ef53-404c-9810-0e7c0e933681_del complete
Nov 08 20:27:46 user nova-compute[74638]: INFO nova.compute.manager [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 08 20:27:46 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:27:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:27:46 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Took 0.73 seconds to deallocate network for instance.
Nov 08 20:27:46 user nova-compute[74638]: WARNING nova.volume.cinder [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Attachment 457b88ab-e3da-4cbd-baff-d89cb8e1ac70 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 457b88ab-e3da-4cbd-baff-d89cb8e1ac70. (HTTP 404) (Request-ID: req-238ddf74-ec8e-4012-9712-ebc635f98936)
Nov 08 20:27:46 user nova-compute[74638]: INFO nova.compute.manager [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 20:27:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:47 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Deleted allocations for instance a7641b40-ef53-404c-9810-0e7c0e933681
Nov 08 20:27:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f56fc88-133d-4b01-99fc-beddddf4b719 tempest-VolumesSnapshotTestJSON-1022894138 tempest-VolumesSnapshotTestJSON-1022894138-project-member] Lock "a7641b40-ef53-404c-9810-0e7c0e933681" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.389s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-c918c4f3-6d6c-4a92-8b58-7d0bf0b557d8 req-51278b27-6b16-4464-a34b-d364bafd9658 service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received event network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c918c4f3-6d6c-4a92-8b58-7d0bf0b557d8 req-51278b27-6b16-4464-a34b-d364bafd9658 service nova] Acquiring lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c918c4f3-6d6c-4a92-8b58-7d0bf0b557d8 req-51278b27-6b16-4464-a34b-d364bafd9658 service nova] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c918c4f3-6d6c-4a92-8b58-7d0bf0b557d8 req-51278b27-6b16-4464-a34b-d364bafd9658 service nova] Lock "a7641b40-ef53-404c-9810-0e7c0e933681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:27:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-c918c4f3-6d6c-4a92-8b58-7d0bf0b557d8 req-51278b27-6b16-4464-a34b-d364bafd9658 service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] No waiting events found dispatching network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:27:47 user nova-compute[74638]: WARNING nova.compute.manager [req-c918c4f3-6d6c-4a92-8b58-7d0bf0b557d8 req-51278b27-6b16-4464-a34b-d364bafd9658 service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received unexpected event network-vif-plugged-56275862-8342-4215-94b1-e6a8ecb2a2be for instance with vm_state deleted and task_state None.
Nov 08 20:27:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-c918c4f3-6d6c-4a92-8b58-7d0bf0b557d8 req-51278b27-6b16-4464-a34b-d364bafd9658 service nova] [instance: a7641b40-ef53-404c-9810-0e7c0e933681] Received event network-vif-deleted-56275862-8342-4215-94b1-e6a8ecb2a2be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:27:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:27:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:27:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:27:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:27:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:27:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:01 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:05 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:28:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:28:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:28:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:28:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:28:07 user nova-compute[74638]: INFO nova.compute.claims [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Claim successful on node user
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:28:07 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.policy [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5d2a2e56dfc441ea12bfe9a89527a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad76637f4c184691893fc1c41cb6d08c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:28:07 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Creating image(s)
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk 1073741824" returned: 0 in 0.048s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.169s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Successfully created port: eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Cannot resize image /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Ensure instance console log exists: /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Successfully updated port: eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquired lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-2c836a61-6d5e-4112-bd82-2e740b04dec4 req-c7308d9e-9bba-4fcd-b630-1b8e1815376d service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-changed-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-2c836a61-6d5e-4112-bd82-2e740b04dec4 req-c7308d9e-9bba-4fcd-b630-1b8e1815376d service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Refreshing instance network info cache due to event network-changed-eb11383c-4b16-4824-bfff-4eedb2dcda08. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2c836a61-6d5e-4112-bd82-2e740b04dec4 req-c7308d9e-9bba-4fcd-b630-1b8e1815376d service nova] Acquiring lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.neutron [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating instance_info_cache with network_info: [{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Releasing lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance network_info: |[{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2c836a61-6d5e-4112-bd82-2e740b04dec4 req-c7308d9e-9bba-4fcd-b630-1b8e1815376d service nova] Acquired lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-2c836a61-6d5e-4112-bd82-2e740b04dec4 req-c7308d9e-9bba-4fcd-b630-1b8e1815376d service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Refreshing network info cache for port eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Start _get_guest_xml network_info=[{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:28:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:28:09 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1699605769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1699605769',id=32,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWaFwkY2NS87T6PgIiYutByvkZteVxZKIwNP2LzlkZOYzVKOH4Nl2XHk3cvHIPUTTrjpWOTVdOD3OK+OU1RlXTEly6HwPaCwcICBnz9In5k5jEqZRqdc4qSg4uHjrR3A==',key_name='tempest-keypair-2077397320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-m0ncmvqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:28:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=5403e126-4e0c-457f-9498-f30c802e4221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'pci_devices' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:28:09 user nova-compute[74638]:   <uuid>5403e126-4e0c-457f-9498-f30c802e4221</uuid>
Nov 08 20:28:09 user nova-compute[74638]:   <name>instance-00000020</name>
Nov 08 20:28:09 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:28:09 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:28:09 user nova-compute[74638]:   <metadata>
Nov 08 20:28:09 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:28:09 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:28:09 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1699605769</nova:name>
Nov 08 20:28:09 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:28:09</nova:creationTime>
Nov 08 20:28:09 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:28:09 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:28:09 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:28:09 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:28:09 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:28:09 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:28:09 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:28:09 user nova-compute[74638]:       <nova:owner>
Nov 08 20:28:09 user nova-compute[74638]:         <nova:user uuid="e5d2a2e56dfc441ea12bfe9a89527a2d">tempest-AttachVolumeShelveTestJSON-1349495348-project-member</nova:user>
Nov 08 20:28:09 user nova-compute[74638]:         <nova:project uuid="ad76637f4c184691893fc1c41cb6d08c">tempest-AttachVolumeShelveTestJSON-1349495348</nova:project>
Nov 08 20:28:09 user nova-compute[74638]:       </nova:owner>
Nov 08 20:28:09 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:28:09 user nova-compute[74638]:       <nova:ports>
Nov 08 20:28:09 user nova-compute[74638]:         <nova:port uuid="eb11383c-4b16-4824-bfff-4eedb2dcda08">
Nov 08 20:28:09 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:28:09 user nova-compute[74638]:         </nova:port>
Nov 08 20:28:09 user nova-compute[74638]:       </nova:ports>
Nov 08 20:28:09 user nova-compute[74638]:     </nova:instance>
Nov 08 20:28:09 user nova-compute[74638]:   </metadata>
Nov 08 20:28:09 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:28:09 user nova-compute[74638]:     <system>
Nov 08 20:28:09 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:28:09 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:28:09 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:28:09 user nova-compute[74638]:       <entry name="serial">5403e126-4e0c-457f-9498-f30c802e4221</entry>
Nov 08 20:28:09 user nova-compute[74638]:       <entry name="uuid">5403e126-4e0c-457f-9498-f30c802e4221</entry>
Nov 08 20:28:09 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:28:09 user nova-compute[74638]:     </system>
Nov 08 20:28:09 user nova-compute[74638]:   </sysinfo>
Nov 08 20:28:09 user nova-compute[74638]:   <os>
Nov 08 20:28:09 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:28:09 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:28:09 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:28:09 user nova-compute[74638]:   </os>
Nov 08 20:28:09 user nova-compute[74638]:   <features>
Nov 08 20:28:09 user nova-compute[74638]:     <acpi/>
Nov 08 20:28:09 user nova-compute[74638]:     <apic/>
Nov 08 20:28:09 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:28:09 user nova-compute[74638]:   </features>
Nov 08 20:28:09 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:28:09 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:28:09 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:28:09 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:28:09 user nova-compute[74638]:   </clock>
Nov 08 20:28:09 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:28:09 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:28:09 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:28:09 user nova-compute[74638]:   </cpu>
Nov 08 20:28:09 user nova-compute[74638]:   <devices>
Nov 08 20:28:09 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:28:09 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:28:09 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk"/>
Nov 08 20:28:09 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:28:09 user nova-compute[74638]:     </disk>
Nov 08 20:28:09 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:28:09 user nova-compute[74638]:       <mac address="fa:16:3e:a2:66:37"/>
Nov 08 20:28:09 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:28:09 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:28:09 user nova-compute[74638]:       <target dev="tapeb11383c-4b"/>
Nov 08 20:28:09 user nova-compute[74638]:     </interface>
Nov 08 20:28:09 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:28:09 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/console.log" append="off"/>
Nov 08 20:28:09 user nova-compute[74638]:     </serial>
Nov 08 20:28:09 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:28:09 user nova-compute[74638]:     <video>
Nov 08 20:28:09 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:28:09 user nova-compute[74638]:     </video>
Nov 08 20:28:09 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:28:09 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:28:09 user nova-compute[74638]:     </rng>
Nov 08 20:28:09 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:28:09 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:28:09 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:28:09 user nova-compute[74638]:     </memballoon>
Nov 08 20:28:09 user nova-compute[74638]:   </devices>
Nov 08 20:28:09 user nova-compute[74638]: </domain>
Nov 08 20:28:09 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1699605769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1699605769',id=32,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWaFwkY2NS87T6PgIiYutByvkZteVxZKIwNP2LzlkZOYzVKOH4Nl2XHk3cvHIPUTTrjpWOTVdOD3OK+OU1RlXTEly6HwPaCwcICBnz9In5k5jEqZRqdc4qSg4uHjrR3A==',key_name='tempest-keypair-2077397320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-m0ncmvqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:28:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=5403e126-4e0c-457f-9498-f30c802e4221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG os_vif [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '219e8ac9-69b3-5249-bf64-3d6818725c62', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb11383c-4b, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb11383c-4b, col_values=(('qos', UUID('42a5229a-c03d-472b-9d54-2e1b96e089b7')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb11383c-4b, col_values=(('external_ids', {'iface-id': 'eb11383c-4b16-4824-bfff-4eedb2dcda08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:66:37', 'vm-uuid': '5403e126-4e0c-457f-9498-f30c802e4221'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:09 user nova-compute[74638]: INFO os_vif [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b')
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No VIF found with MAC fa:16:3e:a2:66:37, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-2c836a61-6d5e-4112-bd82-2e740b04dec4 req-c7308d9e-9bba-4fcd-b630-1b8e1815376d service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updated VIF entry in instance network info cache for port eb11383c-4b16-4824-bfff-4eedb2dcda08. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-2c836a61-6d5e-4112-bd82-2e740b04dec4 req-c7308d9e-9bba-4fcd-b630-1b8e1815376d service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating instance_info_cache with network_info: [{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2c836a61-6d5e-4112-bd82-2e740b04dec4 req-c7308d9e-9bba-4fcd-b630-1b8e1815376d service nova] Releasing lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:28:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:10 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0e529715-d390-4929-998f-5835de148256] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0e529715-d390-4929-998f-5835de148256] Updating instance_info_cache with network_info: [{"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0e529715-d390-4929-998f-5835de148256] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-cb1ef401-38d5-4926-a84c-554e0075573e req-bb60e74d-1eee-4056-b2d7-33fabcf72e1a service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb1ef401-38d5-4926-a84c-554e0075573e req-bb60e74d-1eee-4056-b2d7-33fabcf72e1a service nova] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb1ef401-38d5-4926-a84c-554e0075573e req-bb60e74d-1eee-4056-b2d7-33fabcf72e1a service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cb1ef401-38d5-4926-a84c-554e0075573e req-bb60e74d-1eee-4056-b2d7-33fabcf72e1a service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-cb1ef401-38d5-4926-a84c-554e0075573e req-bb60e74d-1eee-4056-b2d7-33fabcf72e1a service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] No waiting events found dispatching network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:11 user nova-compute[74638]: WARNING nova.compute.manager [req-cb1ef401-38d5-4926-a84c-554e0075573e req-bb60e74d-1eee-4056-b2d7-33fabcf72e1a service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received unexpected event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 for instance with vm_state building and task_state spawning.
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-9d16b47d-4033-402c-9e0e-cbb59c44de32 req-14e6176a-8ab1-48ab-8af5-1b526d3a7174 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9d16b47d-4033-402c-9e0e-cbb59c44de32 req-14e6176a-8ab1-48ab-8af5-1b526d3a7174 service nova] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9d16b47d-4033-402c-9e0e-cbb59c44de32 req-14e6176a-8ab1-48ab-8af5-1b526d3a7174 service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9d16b47d-4033-402c-9e0e-cbb59c44de32 req-14e6176a-8ab1-48ab-8af5-1b526d3a7174 service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-9d16b47d-4033-402c-9e0e-cbb59c44de32 req-14e6176a-8ab1-48ab-8af5-1b526d3a7174 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] No waiting events found dispatching network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:13 user nova-compute[74638]: WARNING nova.compute.manager [req-9d16b47d-4033-402c-9e0e-cbb59c44de32 req-14e6176a-8ab1-48ab-8af5-1b526d3a7174 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received unexpected event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 for instance with vm_state building and task_state spawning.
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:28:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance spawned successfully.
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:13 user nova-compute[74638]: INFO nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:28:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:14 user nova-compute[74638]: INFO nova.compute.manager [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Took 6.90 seconds to build instance.
Nov 08 20:28:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8a6cb3b7-77d9-4d0d-9de1-02b82fef7aba tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.009s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:15 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:28:15 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=25.103626251220703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0e529715-d390-4929-998f-5835de148256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5403e126-4e0c-457f-9498-f30c802e4221 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:28:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:28:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:28:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:28:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:28:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:23 user nova-compute[74638]: INFO nova.compute.manager [None req-338e55af-1c19-40a6-b61b-9c88a5d36ee9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Unrescuing
Nov 08 20:28:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-338e55af-1c19-40a6-b61b-9c88a5d36ee9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-338e55af-1c19-40a6-b61b-9c88a5d36ee9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquired lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-338e55af-1c19-40a6-b61b-9c88a5d36ee9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-338e55af-1c19-40a6-b61b-9c88a5d36ee9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating instance_info_cache with network_info: [{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-338e55af-1c19-40a6-b61b-9c88a5d36ee9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Releasing lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG nova.objects.instance [None req-338e55af-1c19-40a6-b61b-9c88a5d36ee9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'flavor' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-6998246b-645e-4765-ad5d-6e12f9d6713a req-e13a44ed-29d7-4e49-9e90-79611f0407ed service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6998246b-645e-4765-ad5d-6e12f9d6713a req-e13a44ed-29d7-4e49-9e90-79611f0407ed service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6998246b-645e-4765-ad5d-6e12f9d6713a req-e13a44ed-29d7-4e49-9e90-79611f0407ed service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6998246b-645e-4765-ad5d-6e12f9d6713a req-e13a44ed-29d7-4e49-9e90-79611f0407ed service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-6998246b-645e-4765-ad5d-6e12f9d6713a req-e13a44ed-29d7-4e49-9e90-79611f0407ed service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:23 user nova-compute[74638]: WARNING nova.compute.manager [req-6998246b-645e-4765-ad5d-6e12f9d6713a req-e13a44ed-29d7-4e49-9e90-79611f0407ed service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:28:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:24 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance destroyed successfully.
Nov 08 20:28:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-de3c112d-f0d1-45cd-aae9-1b140bfe60b8 req-b6785b53-3ee6-4d6d-aac2-69478ae07ba6 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-de3c112d-f0d1-45cd-aae9-1b140bfe60b8 req-b6785b53-3ee6-4d6d-aac2-69478ae07ba6 service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-de3c112d-f0d1-45cd-aae9-1b140bfe60b8 req-b6785b53-3ee6-4d6d-aac2-69478ae07ba6 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-de3c112d-f0d1-45cd-aae9-1b140bfe60b8 req-b6785b53-3ee6-4d6d-aac2-69478ae07ba6 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-de3c112d-f0d1-45cd-aae9-1b140bfe60b8 req-b6785b53-3ee6-4d6d-aac2-69478ae07ba6 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:25 user nova-compute[74638]: WARNING nova.compute.manager [req-de3c112d-f0d1-45cd-aae9-1b140bfe60b8 req-b6785b53-3ee6-4d6d-aac2-69478ae07ba6 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:28:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:28 user nova-compute[74638]: WARNING nova.compute.manager [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:28:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:28 user nova-compute[74638]: WARNING nova.compute.manager [req-418b2acc-eea4-436b-8af8-363eaf525ba5 req-7c83887e-468b-49ce-a315-e2899d12a915 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:28:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-338e55af-1c19-40a6-b61b-9c88a5d36ee9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:28:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-9740138c-80dc-4d54-9c17-738e2ac2b260 req-9f69efb4-9dc0-4556-8857-722d1a6f37b9 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Received event network-changed-a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-9740138c-80dc-4d54-9c17-738e2ac2b260 req-9f69efb4-9dc0-4556-8857-722d1a6f37b9 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Refreshing instance network info cache due to event network-changed-a69986fb-6b77-46b9-a993-b37e8a9dbb67. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9740138c-80dc-4d54-9c17-738e2ac2b260 req-9f69efb4-9dc0-4556-8857-722d1a6f37b9 service nova] Acquiring lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9740138c-80dc-4d54-9c17-738e2ac2b260 req-9f69efb4-9dc0-4556-8857-722d1a6f37b9 service nova] Acquired lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-9740138c-80dc-4d54-9c17-738e2ac2b260 req-9f69efb4-9dc0-4556-8857-722d1a6f37b9 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Refreshing network info cache for port a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "0e529715-d390-4929-998f-5835de148256" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "0e529715-d390-4929-998f-5835de148256-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:45 user nova-compute[74638]: INFO nova.compute.manager [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Terminating instance
Nov 08 20:28:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-9740138c-80dc-4d54-9c17-738e2ac2b260 req-9f69efb4-9dc0-4556-8857-722d1a6f37b9 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Updated VIF entry in instance network info cache for port a69986fb-6b77-46b9-a993-b37e8a9dbb67. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-9740138c-80dc-4d54-9c17-738e2ac2b260 req-9f69efb4-9dc0-4556-8857-722d1a6f37b9 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Updating instance_info_cache with network_info: [{"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9740138c-80dc-4d54-9c17-738e2ac2b260 req-9f69efb4-9dc0-4556-8857-722d1a6f37b9 service nova] Releasing lock "refresh_cache-0e529715-d390-4929-998f-5835de148256" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0e529715-d390-4929-998f-5835de148256] Instance destroyed successfully.
Nov 08 20:28:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lazy-loading 'resources' on Instance uuid 0e529715-d390-4929-998f-5835de148256 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-701485231',display_name='tempest-TestStampPattern-server-701485231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-701485231',id=24,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxvPfR3m68mdARrbfav97jTy/o6OtKTjWJzrXNp0gr/QQk683HsyF983f34HQBJajTLCCF+GqbGWDF/11evWSydJuVmWuB9oczkR7bNKj4AYdUUQAWpsJK386HZ1lIOpA==',key_name='tempest-TestStampPattern-1081975694',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1466c6af77ed4c838f917c826e4c3594',ramdisk_id='',reservation_id='r-o4wgvurw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-248486380',owner_user_name='tempest-TestStampPattern-248486380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:23:31Z,user_data=None,user_id='5b93d3cfa1354826ab6ff1efbe49f46d',uuid=0e529715-d390-4929-998f-5835de148256,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converting VIF {"id": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "address": "fa:16:3e:85:76:62", "network": {"id": "b85204aa-c885-446c-9e95-ec5d83817591", "bridge": "br-int", "label": "tempest-TestStampPattern-200608693-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1466c6af77ed4c838f917c826e4c3594", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa69986fb-6b", "ovs_interfaceid": "a69986fb-6b77-46b9-a993-b37e8a9dbb67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:76:62,bridge_name='br-int',has_traffic_filtering=True,id=a69986fb-6b77-46b9-a993-b37e8a9dbb67,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69986fb-6b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG os_vif [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:76:62,bridge_name='br-int',has_traffic_filtering=True,id=a69986fb-6b77-46b9-a993-b37e8a9dbb67,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69986fb-6b') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa69986fb-6b, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6d0fff9-f631-4e2e-8859-2161cf34a467) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:46 user nova-compute[74638]: INFO os_vif [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:76:62,bridge_name='br-int',has_traffic_filtering=True,id=a69986fb-6b77-46b9-a993-b37e8a9dbb67,network=Network(b85204aa-c885-446c-9e95-ec5d83817591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa69986fb-6b')
Nov 08 20:28:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Deleting instance files /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256_del
Nov 08 20:28:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Deletion of /opt/stack/data/nova/instances/0e529715-d390-4929-998f-5835de148256_del complete
Nov 08 20:28:46 user nova-compute[74638]: INFO nova.compute.manager [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] [instance: 0e529715-d390-4929-998f-5835de148256] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 20:28:46 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 0e529715-d390-4929-998f-5835de148256] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:28:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 0e529715-d390-4929-998f-5835de148256] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:28:47 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 0e529715-d390-4929-998f-5835de148256] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-72ad07cf-e1b0-4415-84e6-a08e11f0473e req-ccb983c8-51b5-4505-bef6-c129027616f6 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Received event network-vif-deleted-a69986fb-6b77-46b9-a993-b37e8a9dbb67 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:47 user nova-compute[74638]: INFO nova.compute.manager [req-72ad07cf-e1b0-4415-84e6-a08e11f0473e req-ccb983c8-51b5-4505-bef6-c129027616f6 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Neutron deleted interface a69986fb-6b77-46b9-a993-b37e8a9dbb67; detaching it from the instance and deleting it from the info cache
Nov 08 20:28:47 user nova-compute[74638]: DEBUG nova.network.neutron [req-72ad07cf-e1b0-4415-84e6-a08e11f0473e req-ccb983c8-51b5-4505-bef6-c129027616f6 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:47 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 0e529715-d390-4929-998f-5835de148256] Took 0.77 seconds to deallocate network for instance.
Nov 08 20:28:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-72ad07cf-e1b0-4415-84e6-a08e11f0473e req-ccb983c8-51b5-4505-bef6-c129027616f6 service nova] [instance: 0e529715-d390-4929-998f-5835de148256] Detach interface failed, port_id=a69986fb-6b77-46b9-a993-b37e8a9dbb67, reason: Instance 0e529715-d390-4929-998f-5835de148256 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:28:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:47 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:28:47 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:28:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:47 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Deleted allocations for instance 0e529715-d390-4929-998f-5835de148256
Nov 08 20:28:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-922ad643-4554-4a72-9f86-925d82ef9c64 tempest-TestStampPattern-248486380 tempest-TestStampPattern-248486380-project-member] Lock "0e529715-d390-4929-998f-5835de148256" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.271s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:28:50 user nova-compute[74638]: INFO nova.compute.claims [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Claim successful on node user
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:28:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.policy [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ab02946569c47ff9772753454afc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69c08c247c41cd842c3673cf9af390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:28:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Creating image(s)
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "/opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "/opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:50 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk 1073741824" returned: 0 in 0.056s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Successfully created port: 5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Cannot resize image /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Ensure instance console log exists: /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Successfully updated port: 5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquired lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-e33b4882-d80b-4659-b8ad-07910928afed req-f2b9ef7b-d3c9-4b28-aaca-994b344264a4 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received event network-changed-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-e33b4882-d80b-4659-b8ad-07910928afed req-f2b9ef7b-d3c9-4b28-aaca-994b344264a4 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Refreshing instance network info cache due to event network-changed-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e33b4882-d80b-4659-b8ad-07910928afed req-f2b9ef7b-d3c9-4b28-aaca-994b344264a4 service nova] Acquiring lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Updating instance_info_cache with network_info: [{"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Releasing lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Instance network_info: |[{"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e33b4882-d80b-4659-b8ad-07910928afed req-f2b9ef7b-d3c9-4b28-aaca-994b344264a4 service nova] Acquired lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-e33b4882-d80b-4659-b8ad-07910928afed req-f2b9ef7b-d3c9-4b28-aaca-994b344264a4 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Refreshing network info cache for port 5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Start _get_guest_xml network_info=[{"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:28:52 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:28:52 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1285470780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1285470780',id=33,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-tfqrmb0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:28:51Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=3f30e649-f2c0-4b9d-8446-329b1ea7dc9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b6:94,bridge_name='br-int',has_traffic_filtering=True,id=5a3613fe-a2ba-4acf-826c-fe11b3bc79c3,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3613fe-a2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:28:52 user nova-compute[74638]:   <uuid>3f30e649-f2c0-4b9d-8446-329b1ea7dc9d</uuid>
Nov 08 20:28:52 user nova-compute[74638]:   <name>instance-00000021</name>
Nov 08 20:28:52 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:28:52 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:28:52 user nova-compute[74638]:   <metadata>
Nov 08 20:28:52 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:28:52 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:28:52 user nova-compute[74638]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1285470780</nova:name>
Nov 08 20:28:52 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:28:52</nova:creationTime>
Nov 08 20:28:52 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:28:52 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:28:52 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:28:52 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:28:52 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:28:52 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:28:52 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:28:52 user nova-compute[74638]:       <nova:owner>
Nov 08 20:28:52 user nova-compute[74638]:         <nova:user uuid="9ab02946569c47ff9772753454afc5b3">tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member</nova:user>
Nov 08 20:28:52 user nova-compute[74638]:         <nova:project uuid="9d69c08c247c41cd842c3673cf9af390">tempest-ServerBootFromVolumeStableRescueTest-1821986023</nova:project>
Nov 08 20:28:52 user nova-compute[74638]:       </nova:owner>
Nov 08 20:28:52 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:28:52 user nova-compute[74638]:       <nova:ports>
Nov 08 20:28:52 user nova-compute[74638]:         <nova:port uuid="5a3613fe-a2ba-4acf-826c-fe11b3bc79c3">
Nov 08 20:28:52 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 20:28:52 user nova-compute[74638]:         </nova:port>
Nov 08 20:28:52 user nova-compute[74638]:       </nova:ports>
Nov 08 20:28:52 user nova-compute[74638]:     </nova:instance>
Nov 08 20:28:52 user nova-compute[74638]:   </metadata>
Nov 08 20:28:52 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:28:52 user nova-compute[74638]:     <system>
Nov 08 20:28:52 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:28:52 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:28:52 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:28:52 user nova-compute[74638]:       <entry name="serial">3f30e649-f2c0-4b9d-8446-329b1ea7dc9d</entry>
Nov 08 20:28:52 user nova-compute[74638]:       <entry name="uuid">3f30e649-f2c0-4b9d-8446-329b1ea7dc9d</entry>
Nov 08 20:28:52 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:28:52 user nova-compute[74638]:     </system>
Nov 08 20:28:52 user nova-compute[74638]:   </sysinfo>
Nov 08 20:28:52 user nova-compute[74638]:   <os>
Nov 08 20:28:52 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:28:52 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:28:52 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:28:52 user nova-compute[74638]:   </os>
Nov 08 20:28:52 user nova-compute[74638]:   <features>
Nov 08 20:28:52 user nova-compute[74638]:     <acpi/>
Nov 08 20:28:52 user nova-compute[74638]:     <apic/>
Nov 08 20:28:52 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:28:52 user nova-compute[74638]:   </features>
Nov 08 20:28:52 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:28:52 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:28:52 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:28:52 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:28:52 user nova-compute[74638]:   </clock>
Nov 08 20:28:52 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:28:52 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:28:52 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:28:52 user nova-compute[74638]:   </cpu>
Nov 08 20:28:52 user nova-compute[74638]:   <devices>
Nov 08 20:28:52 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:28:52 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:28:52 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk"/>
Nov 08 20:28:52 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:28:52 user nova-compute[74638]:     </disk>
Nov 08 20:28:52 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:28:52 user nova-compute[74638]:       <mac address="fa:16:3e:b7:b6:94"/>
Nov 08 20:28:52 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:28:52 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:28:52 user nova-compute[74638]:       <target dev="tap5a3613fe-a2"/>
Nov 08 20:28:52 user nova-compute[74638]:     </interface>
Nov 08 20:28:52 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:28:52 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/console.log" append="off"/>
Nov 08 20:28:52 user nova-compute[74638]:     </serial>
Nov 08 20:28:52 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:28:52 user nova-compute[74638]:     <video>
Nov 08 20:28:52 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:28:52 user nova-compute[74638]:     </video>
Nov 08 20:28:52 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:28:52 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:28:52 user nova-compute[74638]:     </rng>
Nov 08 20:28:52 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:28:52 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:28:52 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:28:52 user nova-compute[74638]:     </memballoon>
Nov 08 20:28:52 user nova-compute[74638]:   </devices>
Nov 08 20:28:52 user nova-compute[74638]: </domain>
Nov 08 20:28:52 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1285470780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1285470780',id=33,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-tfqrmb0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:28:51Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=3f30e649-f2c0-4b9d-8446-329b1ea7dc9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b6:94,bridge_name='br-int',has_traffic_filtering=True,id=5a3613fe-a2ba-4acf-826c-fe11b3bc79c3,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3613fe-a2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG os_vif [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b6:94,bridge_name='br-int',has_traffic_filtering=True,id=5a3613fe-a2ba-4acf-826c-fe11b3bc79c3,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3613fe-a2') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb9f5312-b19e-537c-aa08-d4169505202a', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a3613fe-a2, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a3613fe-a2, col_values=(('qos', UUID('4731b347-26f6-4ceb-91a2-92b3ba75717f')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a3613fe-a2, col_values=(('external_ids', {'iface-id': '5a3613fe-a2ba-4acf-826c-fe11b3bc79c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:b6:94', 'vm-uuid': '3f30e649-f2c0-4b9d-8446-329b1ea7dc9d'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:52 user nova-compute[74638]: INFO os_vif [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b6:94,bridge_name='br-int',has_traffic_filtering=True,id=5a3613fe-a2ba-4acf-826c-fe11b3bc79c3,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3613fe-a2')
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No VIF found with MAC fa:16:3e:b7:b6:94, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-e33b4882-d80b-4659-b8ad-07910928afed req-f2b9ef7b-d3c9-4b28-aaca-994b344264a4 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Updated VIF entry in instance network info cache for port 5a3613fe-a2ba-4acf-826c-fe11b3bc79c3. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-e33b4882-d80b-4659-b8ad-07910928afed req-f2b9ef7b-d3c9-4b28-aaca-994b344264a4 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Updating instance_info_cache with network_info: [{"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e33b4882-d80b-4659-b8ad-07910928afed req-f2b9ef7b-d3c9-4b28-aaca-994b344264a4 service nova] Releasing lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:28:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:28:53 user nova-compute[74638]: INFO nova.compute.claims [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Claim successful on node user
Nov 08 20:28:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-1d04e7e6-f092-44a0-8160-4bbd59ba0bbf req-ee7967a4-32ed-4427-b0d9-c3af2aff53cb service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received event network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1d04e7e6-f092-44a0-8160-4bbd59ba0bbf req-ee7967a4-32ed-4427-b0d9-c3af2aff53cb service nova] Acquiring lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1d04e7e6-f092-44a0-8160-4bbd59ba0bbf req-ee7967a4-32ed-4427-b0d9-c3af2aff53cb service nova] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1d04e7e6-f092-44a0-8160-4bbd59ba0bbf req-ee7967a4-32ed-4427-b0d9-c3af2aff53cb service nova] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-1d04e7e6-f092-44a0-8160-4bbd59ba0bbf req-ee7967a4-32ed-4427-b0d9-c3af2aff53cb service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] No waiting events found dispatching network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:54 user nova-compute[74638]: WARNING nova.compute.manager [req-1d04e7e6-f092-44a0-8160-4bbd59ba0bbf req-ee7967a4-32ed-4427-b0d9-c3af2aff53cb service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received unexpected event network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 for instance with vm_state building and task_state spawning.
Nov 08 20:28:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.policy [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3b8411366b341f5936fffed75e319e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45047adc05a46db9f719f9d0579c276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:28:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Creating image(s)
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "/opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "/opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.277s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk 1073741824" returned: 0 in 0.063s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Successfully created port: 8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.222s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Cannot resize image /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Ensure instance console log exists: /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Successfully updated port: 8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "refresh_cache-ea1d94b0-c598-4d3b-953b-2822809ef548" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquired lock "refresh_cache-ea1d94b0-c598-4d3b-953b-2822809ef548" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-11118b32-1c8b-4aae-8f77-c3b14cd209c1 req-cd74090c-6f22-467e-90c2-90497e5bab54 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-changed-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-11118b32-1c8b-4aae-8f77-c3b14cd209c1 req-cd74090c-6f22-467e-90c2-90497e5bab54 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Refreshing instance network info cache due to event network-changed-8fdb39c4-229b-4abe-829a-d526f8a9073b. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:28:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-11118b32-1c8b-4aae-8f77-c3b14cd209c1 req-cd74090c-6f22-467e-90c2-90497e5bab54 service nova] Acquiring lock "refresh_cache-ea1d94b0-c598-4d3b-953b-2822809ef548" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-3c6a31d7-9b75-45d6-8ed9-8cf14591c213 req-736828c2-8605-4711-9aed-38615c7ef834 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received event network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3c6a31d7-9b75-45d6-8ed9-8cf14591c213 req-736828c2-8605-4711-9aed-38615c7ef834 service nova] Acquiring lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3c6a31d7-9b75-45d6-8ed9-8cf14591c213 req-736828c2-8605-4711-9aed-38615c7ef834 service nova] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3c6a31d7-9b75-45d6-8ed9-8cf14591c213 req-736828c2-8605-4711-9aed-38615c7ef834 service nova] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-3c6a31d7-9b75-45d6-8ed9-8cf14591c213 req-736828c2-8605-4711-9aed-38615c7ef834 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] No waiting events found dispatching network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:56 user nova-compute[74638]: WARNING nova.compute.manager [req-3c6a31d7-9b75-45d6-8ed9-8cf14591c213 req-736828c2-8605-4711-9aed-38615c7ef834 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received unexpected event network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 for instance with vm_state building and task_state spawning.
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:28:56 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Instance spawned successfully.
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Updating instance_info_cache with network_info: [{"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Releasing lock "refresh_cache-ea1d94b0-c598-4d3b-953b-2822809ef548" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Instance network_info: |[{"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-11118b32-1c8b-4aae-8f77-c3b14cd209c1 req-cd74090c-6f22-467e-90c2-90497e5bab54 service nova] Acquired lock "refresh_cache-ea1d94b0-c598-4d3b-953b-2822809ef548" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-11118b32-1c8b-4aae-8f77-c3b14cd209c1 req-cd74090c-6f22-467e-90c2-90497e5bab54 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Refreshing network info cache for port 8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Start _get_guest_xml network_info=[{"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:28:56 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:28:56 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:28:56 user nova-compute[74638]: INFO nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1696281941',display_name='tempest-VolumesActionsTest-instance-1696281941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1696281941',id=34,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d45047adc05a46db9f719f9d0579c276',ramdisk_id='',reservation_id='r-x1fzfbvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1038485660',owner_user_name='tempest-VolumesActionsTest-1038485660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:28:54Z,user_data=None,user_id='c3b8411366b341f5936fffed75e319e7',uuid=ea1d94b0-c598-4d3b-953b-2822809ef548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converting VIF {"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:de:02,bridge_name='br-int',has_traffic_filtering=True,id=8fdb39c4-229b-4abe-829a-d526f8a9073b,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fdb39c4-22') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lazy-loading 'pci_devices' on Instance uuid ea1d94b0-c598-4d3b-953b-2822809ef548 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:28:56 user nova-compute[74638]:   <uuid>ea1d94b0-c598-4d3b-953b-2822809ef548</uuid>
Nov 08 20:28:56 user nova-compute[74638]:   <name>instance-00000022</name>
Nov 08 20:28:56 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:28:56 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:28:56 user nova-compute[74638]:   <metadata>
Nov 08 20:28:56 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:28:56 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:28:56 user nova-compute[74638]:       <nova:name>tempest-VolumesActionsTest-instance-1696281941</nova:name>
Nov 08 20:28:56 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:28:56</nova:creationTime>
Nov 08 20:28:56 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:28:56 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:28:56 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:28:56 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:28:56 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:28:56 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:28:56 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:28:56 user nova-compute[74638]:       <nova:owner>
Nov 08 20:28:56 user nova-compute[74638]:         <nova:user uuid="c3b8411366b341f5936fffed75e319e7">tempest-VolumesActionsTest-1038485660-project-member</nova:user>
Nov 08 20:28:56 user nova-compute[74638]:         <nova:project uuid="d45047adc05a46db9f719f9d0579c276">tempest-VolumesActionsTest-1038485660</nova:project>
Nov 08 20:28:56 user nova-compute[74638]:       </nova:owner>
Nov 08 20:28:56 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:28:56 user nova-compute[74638]:       <nova:ports>
Nov 08 20:28:56 user nova-compute[74638]:         <nova:port uuid="8fdb39c4-229b-4abe-829a-d526f8a9073b">
Nov 08 20:28:56 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 20:28:56 user nova-compute[74638]:         </nova:port>
Nov 08 20:28:56 user nova-compute[74638]:       </nova:ports>
Nov 08 20:28:56 user nova-compute[74638]:     </nova:instance>
Nov 08 20:28:56 user nova-compute[74638]:   </metadata>
Nov 08 20:28:56 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:28:56 user nova-compute[74638]:     <system>
Nov 08 20:28:56 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:28:56 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:28:56 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:28:56 user nova-compute[74638]:       <entry name="serial">ea1d94b0-c598-4d3b-953b-2822809ef548</entry>
Nov 08 20:28:56 user nova-compute[74638]:       <entry name="uuid">ea1d94b0-c598-4d3b-953b-2822809ef548</entry>
Nov 08 20:28:56 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:28:56 user nova-compute[74638]:     </system>
Nov 08 20:28:56 user nova-compute[74638]:   </sysinfo>
Nov 08 20:28:56 user nova-compute[74638]:   <os>
Nov 08 20:28:56 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:28:56 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:28:56 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:28:56 user nova-compute[74638]:   </os>
Nov 08 20:28:56 user nova-compute[74638]:   <features>
Nov 08 20:28:56 user nova-compute[74638]:     <acpi/>
Nov 08 20:28:56 user nova-compute[74638]:     <apic/>
Nov 08 20:28:56 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:28:56 user nova-compute[74638]:   </features>
Nov 08 20:28:56 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:28:56 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:28:56 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:28:56 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:28:56 user nova-compute[74638]:   </clock>
Nov 08 20:28:56 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:28:56 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:28:56 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:28:56 user nova-compute[74638]:   </cpu>
Nov 08 20:28:56 user nova-compute[74638]:   <devices>
Nov 08 20:28:56 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:28:56 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:28:56 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk"/>
Nov 08 20:28:56 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:28:56 user nova-compute[74638]:     </disk>
Nov 08 20:28:56 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:28:56 user nova-compute[74638]:       <mac address="fa:16:3e:3a:de:02"/>
Nov 08 20:28:56 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:28:56 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:28:56 user nova-compute[74638]:       <target dev="tap8fdb39c4-22"/>
Nov 08 20:28:56 user nova-compute[74638]:     </interface>
Nov 08 20:28:56 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:28:56 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/console.log" append="off"/>
Nov 08 20:28:56 user nova-compute[74638]:     </serial>
Nov 08 20:28:56 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:28:56 user nova-compute[74638]:     <video>
Nov 08 20:28:56 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:28:56 user nova-compute[74638]:     </video>
Nov 08 20:28:56 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:28:56 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:28:56 user nova-compute[74638]:     </rng>
Nov 08 20:28:56 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:28:56 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:28:56 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:28:56 user nova-compute[74638]:     </memballoon>
Nov 08 20:28:56 user nova-compute[74638]:   </devices>
Nov 08 20:28:56 user nova-compute[74638]: </domain>
Nov 08 20:28:56 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1696281941',display_name='tempest-VolumesActionsTest-instance-1696281941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1696281941',id=34,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d45047adc05a46db9f719f9d0579c276',ramdisk_id='',reservation_id='r-x1fzfbvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1038485660',owner_user_name='tempest-VolumesActionsTest-1038485660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:28:54Z,user_data=None,user_id='c3b8411366b341f5936fffed75e319e7',uuid=ea1d94b0-c598-4d3b-953b-2822809ef548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converting VIF {"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:de:02,bridge_name='br-int',has_traffic_filtering=True,id=8fdb39c4-229b-4abe-829a-d526f8a9073b,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fdb39c4-22') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG os_vif [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:de:02,bridge_name='br-int',has_traffic_filtering=True,id=8fdb39c4-229b-4abe-829a-d526f8a9073b,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fdb39c4-22') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f43944f-f924-5665-bb9e-20bc256ebb69', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fdb39c4-22, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fdb39c4-22, col_values=(('qos', UUID('32a504db-8bde-46db-8b75-67fa454c9193')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fdb39c4-22, col_values=(('external_ids', {'iface-id': '8fdb39c4-229b-4abe-829a-d526f8a9073b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:de:02', 'vm-uuid': 'ea1d94b0-c598-4d3b-953b-2822809ef548'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:28:56 user nova-compute[74638]: INFO nova.compute.manager [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Took 6.47 seconds to build instance.
Nov 08 20:28:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:56 user nova-compute[74638]: INFO os_vif [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:de:02,bridge_name='br-int',has_traffic_filtering=True,id=8fdb39c4-229b-4abe-829a-d526f8a9073b,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fdb39c4-22')
Nov 08 20:28:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3c19f3e9-8842-4ce4-a6f5-a81c05ea120c tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.583s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] No VIF found with MAC fa:16:3e:3a:de:02, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-11118b32-1c8b-4aae-8f77-c3b14cd209c1 req-cd74090c-6f22-467e-90c2-90497e5bab54 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Updated VIF entry in instance network info cache for port 8fdb39c4-229b-4abe-829a-d526f8a9073b. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-11118b32-1c8b-4aae-8f77-c3b14cd209c1 req-cd74090c-6f22-467e-90c2-90497e5bab54 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Updating instance_info_cache with network_info: [{"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:28:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-11118b32-1c8b-4aae-8f77-c3b14cd209c1 req-cd74090c-6f22-467e-90c2-90497e5bab54 service nova] Releasing lock "refresh_cache-ea1d94b0-c598-4d3b-953b-2822809ef548" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-a693f97d-5c87-4df8-90eb-489c21ee3923 req-a32dc8d1-3bd1-4362-b73a-87e983dbf19b service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a693f97d-5c87-4df8-90eb-489c21ee3923 req-a32dc8d1-3bd1-4362-b73a-87e983dbf19b service nova] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a693f97d-5c87-4df8-90eb-489c21ee3923 req-a32dc8d1-3bd1-4362-b73a-87e983dbf19b service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a693f97d-5c87-4df8-90eb-489c21ee3923 req-a32dc8d1-3bd1-4362-b73a-87e983dbf19b service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-a693f97d-5c87-4df8-90eb-489c21ee3923 req-a32dc8d1-3bd1-4362-b73a-87e983dbf19b service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] No waiting events found dispatching network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:28:58 user nova-compute[74638]: WARNING nova.compute.manager [req-a693f97d-5c87-4df8-90eb-489c21ee3923 req-a32dc8d1-3bd1-4362-b73a-87e983dbf19b service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received unexpected event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b for instance with vm_state building and task_state spawning.
Nov 08 20:28:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:28:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-69a91c1f-6bb0-4a4c-bae5-e635e04dd217 req-59208321-84d0-42c5-9845-98019cc76564 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-69a91c1f-6bb0-4a4c-bae5-e635e04dd217 req-59208321-84d0-42c5-9845-98019cc76564 service nova] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-69a91c1f-6bb0-4a4c-bae5-e635e04dd217 req-59208321-84d0-42c5-9845-98019cc76564 service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-69a91c1f-6bb0-4a4c-bae5-e635e04dd217 req-59208321-84d0-42c5-9845-98019cc76564 service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-69a91c1f-6bb0-4a4c-bae5-e635e04dd217 req-59208321-84d0-42c5-9845-98019cc76564 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] No waiting events found dispatching network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:29:00 user nova-compute[74638]: WARNING nova.compute.manager [req-69a91c1f-6bb0-4a4c-bae5-e635e04dd217 req-59208321-84d0-42c5-9845-98019cc76564 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received unexpected event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b for instance with vm_state building and task_state spawning.
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:29:00 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Instance spawned successfully.
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:29:00 user nova-compute[74638]: INFO nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 08 20:29:00 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:29:00 user nova-compute[74638]: INFO nova.compute.manager [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Took 7.26 seconds to build instance.
Nov 08 20:29:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a7286a80-749b-473d-8fe4-196489a99c86 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.385s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:29:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:07 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:29:09 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:09 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5008 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:29:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:29:15 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:29:15 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=7974MB free_disk=25.160236358642578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5403e126-4e0c-457f-9498-f30c802e4221 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance ea1d94b0-c598-4d3b-953b-2822809ef548 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:29:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:29:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:29:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:29:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:29:16 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:29:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updating instance_info_cache with network_info: [{"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:29:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:29:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:29:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:29:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:29:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:29:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:29:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:29:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:29:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:29:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:29:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:29:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:29:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-57e5b676-aa56-4dd7-9061-eb2251fc3d29 req-358d2b52-40e8-4cbc-a58a-eeeaad8bbf64 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-changed-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:29:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-57e5b676-aa56-4dd7-9061-eb2251fc3d29 req-358d2b52-40e8-4cbc-a58a-eeeaad8bbf64 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Refreshing instance network info cache due to event network-changed-eb11383c-4b16-4824-bfff-4eedb2dcda08. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:29:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-57e5b676-aa56-4dd7-9061-eb2251fc3d29 req-358d2b52-40e8-4cbc-a58a-eeeaad8bbf64 service nova] Acquiring lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:29:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-57e5b676-aa56-4dd7-9061-eb2251fc3d29 req-358d2b52-40e8-4cbc-a58a-eeeaad8bbf64 service nova] Acquired lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:29:58 user nova-compute[74638]: DEBUG nova.network.neutron [req-57e5b676-aa56-4dd7-9061-eb2251fc3d29 req-358d2b52-40e8-4cbc-a58a-eeeaad8bbf64 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Refreshing network info cache for port eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:29:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:29:59 user nova-compute[74638]: DEBUG nova.network.neutron [req-57e5b676-aa56-4dd7-9061-eb2251fc3d29 req-358d2b52-40e8-4cbc-a58a-eeeaad8bbf64 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updated VIF entry in instance network info cache for port eb11383c-4b16-4824-bfff-4eedb2dcda08. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:29:59 user nova-compute[74638]: DEBUG nova.network.neutron [req-57e5b676-aa56-4dd7-9061-eb2251fc3d29 req-358d2b52-40e8-4cbc-a58a-eeeaad8bbf64 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating instance_info_cache with network_info: [{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:29:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-57e5b676-aa56-4dd7-9061-eb2251fc3d29 req-358d2b52-40e8-4cbc-a58a-eeeaad8bbf64 service nova] Releasing lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:29:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:06 user nova-compute[74638]: INFO nova.compute.manager [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Shelving
Nov 08 20:30:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-aa6b5c40-c770-4b98-9d81-a305212e26a7 req-ea9765d1-bd0a-48e1-8b09-3003fac58869 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-unplugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aa6b5c40-c770-4b98-9d81-a305212e26a7 req-ea9765d1-bd0a-48e1-8b09-3003fac58869 service nova] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aa6b5c40-c770-4b98-9d81-a305212e26a7 req-ea9765d1-bd0a-48e1-8b09-3003fac58869 service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aa6b5c40-c770-4b98-9d81-a305212e26a7 req-ea9765d1-bd0a-48e1-8b09-3003fac58869 service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-aa6b5c40-c770-4b98-9d81-a305212e26a7 req-ea9765d1-bd0a-48e1-8b09-3003fac58869 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] No waiting events found dispatching network-vif-unplugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:07 user nova-compute[74638]: WARNING nova.compute.manager [req-aa6b5c40-c770-4b98-9d81-a305212e26a7 req-ea9765d1-bd0a-48e1-8b09-3003fac58869 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received unexpected event network-vif-unplugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 for instance with vm_state active and task_state shelving.
Nov 08 20:30:07 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance destroyed successfully.
Nov 08 20:30:07 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Beginning cold snapshot process
Nov 08 20:30:07 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:30:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk /opt/stack/data/nova/instances/snapshots/tmp1ei1yo25/867c2a65675c45b392b3b515dd3aa1cf {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:07 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:30:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk /opt/stack/data/nova/instances/snapshots/tmp1ei1yo25/867c2a65675c45b392b3b515dd3aa1cf" returned: 0 in 0.979s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:08 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Snapshot extracted, beginning image upload
Nov 08 20:30:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-a4070197-4ceb-4f00-8c31-f9ad0de386f9 req-24dfba3c-4ec8-401e-9c55-61f436694c3e service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a4070197-4ceb-4f00-8c31-f9ad0de386f9 req-24dfba3c-4ec8-401e-9c55-61f436694c3e service nova] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a4070197-4ceb-4f00-8c31-f9ad0de386f9 req-24dfba3c-4ec8-401e-9c55-61f436694c3e service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a4070197-4ceb-4f00-8c31-f9ad0de386f9 req-24dfba3c-4ec8-401e-9c55-61f436694c3e service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-a4070197-4ceb-4f00-8c31-f9ad0de386f9 req-24dfba3c-4ec8-401e-9c55-61f436694c3e service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] No waiting events found dispatching network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:09 user nova-compute[74638]: WARNING nova.compute.manager [req-a4070197-4ceb-4f00-8c31-f9ad0de386f9 req-24dfba3c-4ec8-401e-9c55-61f436694c3e service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received unexpected event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 20:30:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:11 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Snapshot image upload complete
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:30:11 user nova-compute[74638]: INFO nova.compute.manager [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Shelve offloading
Nov 08 20:30:11 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance destroyed successfully.
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquired lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:30:11 user nova-compute[74638]: INFO nova.compute.claims [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Claim successful on node user
Nov 08 20:30:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating instance_info_cache with network_info: [{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Releasing lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:30:11 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.policy [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f691961292564fffa7e77b384264c583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b84dfb76a24be7b4f05798c33f7804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:30:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:30:12 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Creating image(s)
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "/opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "/opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:12 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance destroyed successfully.
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'resources' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1699605769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1699605769',id=32,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWaFwkY2NS87T6PgIiYutByvkZteVxZKIwNP2LzlkZOYzVKOH4Nl2XHk3cvHIPUTTrjpWOTVdOD3OK+OU1RlXTEly6HwPaCwcICBnz9In5k5jEqZRqdc4qSg4uHjrR3A==',key_name='tempest-keypair-2077397320',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-m0ncmvqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member',shelved_at='2023-11-08T20:30:11.173024',shelved_host='user',shelved_image_id='fb147b7f-880f-4033-ad5b-16cb3867c3d1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=5403e126-4e0c-457f-9498-f30c802e4221,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG os_vif [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.compute.manager [req-7053849c-3407-46a7-a287-967575bca2d7 req-fa1af546-30c3-4ecf-b8d3-8c08b9e11a20 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-changed-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.compute.manager [req-7053849c-3407-46a7-a287-967575bca2d7 req-fa1af546-30c3-4ecf-b8d3-8c08b9e11a20 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Refreshing instance network info cache due to event network-changed-eb11383c-4b16-4824-bfff-4eedb2dcda08. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7053849c-3407-46a7-a287-967575bca2d7 req-fa1af546-30c3-4ecf-b8d3-8c08b9e11a20 service nova] Acquiring lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7053849c-3407-46a7-a287-967575bca2d7 req-fa1af546-30c3-4ecf-b8d3-8c08b9e11a20 service nova] Acquired lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.network.neutron [req-7053849c-3407-46a7-a287-967575bca2d7 req-fa1af546-30c3-4ecf-b8d3-8c08b9e11a20 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Refreshing network info cache for port eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb11383c-4b, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42a5229a-c03d-472b-9d54-2e1b96e089b7) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:30:12 user nova-compute[74638]: INFO os_vif [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b')
Nov 08 20:30:12 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Deleting instance files /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221_del
Nov 08 20:30:12 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Deletion of /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221_del complete
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk 1073741824" returned: 0 in 0.059s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:12 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Deleted allocations for instance 5403e126-4e0c-457f-9498-f30c802e4221
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'numa_topology' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.objects.base [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<5403e126-4e0c-457f-9498-f30c802e4221> lazy-loaded attributes: resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.network.neutron [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Successfully created port: 4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Cannot resize image /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Ensure instance console log exists: /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.network.neutron [req-7053849c-3407-46a7-a287-967575bca2d7 req-fa1af546-30c3-4ecf-b8d3-8c08b9e11a20 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updated VIF entry in instance network info cache for port eb11383c-4b16-4824-bfff-4eedb2dcda08. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:30:12 user nova-compute[74638]: DEBUG nova.network.neutron [req-7053849c-3407-46a7-a287-967575bca2d7 req-fa1af546-30c3-4ecf-b8d3-8c08b9e11a20 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating instance_info_cache with network_info: [{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapeb11383c-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7053849c-3407-46a7-a287-967575bca2d7 req-fa1af546-30c3-4ecf-b8d3-8c08b9e11a20 service nova] Releasing lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5583ceb5-cff7-4378-b172-d4915a363433 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.801s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Successfully updated port: 4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquired lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-aa5c3776-035f-4f82-a3bd-c6ced0d6d9bc req-069e3a08-cde6-4c5a-b2d2-4802f5a51c98 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received event network-changed-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-aa5c3776-035f-4f82-a3bd-c6ced0d6d9bc req-069e3a08-cde6-4c5a-b2d2-4802f5a51c98 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Refreshing instance network info cache due to event network-changed-4f3e6fde-c683-4e62-ac4c-92810970fbfb. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aa5c3776-035f-4f82-a3bd-c6ced0d6d9bc req-069e3a08-cde6-4c5a-b2d2-4802f5a51c98 service nova] Acquiring lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.neutron [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating instance_info_cache with network_info: [{"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Releasing lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Instance network_info: |[{"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aa5c3776-035f-4f82-a3bd-c6ced0d6d9bc req-069e3a08-cde6-4c5a-b2d2-4802f5a51c98 service nova] Acquired lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-aa5c3776-035f-4f82-a3bd-c6ced0d6d9bc req-069e3a08-cde6-4c5a-b2d2-4802f5a51c98 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Refreshing network info cache for port 4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Start _get_guest_xml network_info=[{"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:14 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:30:14 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1898793169',display_name='tempest-SnapshotDataIntegrityTests-server-1898793169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1898793169',id=35,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGJ4OMVO9CjnqzXjXxTo8JSRgGMBrbgNN8FS8y903Mofdc6Hc3+uhHmeoefq+WcPCxIpGQatPncNMMutoq5wnsuzShqk0LMvVX/SQVf1zfmNwKDH1SCYIk/uW4qy42OIQ==',key_name='tempest-keypair-245506309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77b84dfb76a24be7b4f05798c33f7804',ramdisk_id='',reservation_id='r-9bo263bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-511643886',owner_user_name='tempest-SnapshotDataIntegrityTests-511643886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f691961292564fffa7e77b384264c583',uuid=0b409323-6dcf-4395-92ec-1d79b27c515b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Converting VIF {"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:07:49,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6fde-c683-4e62-ac4c-92810970fbfb,network=Network(e3d53a81-7dda-44fe-85a5-1c9d7c9509f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6fde-c6') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:30:14 user nova-compute[74638]:   <uuid>0b409323-6dcf-4395-92ec-1d79b27c515b</uuid>
Nov 08 20:30:14 user nova-compute[74638]:   <name>instance-00000023</name>
Nov 08 20:30:14 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:30:14 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:30:14 user nova-compute[74638]:   <metadata>
Nov 08 20:30:14 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:30:14 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:30:14 user nova-compute[74638]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1898793169</nova:name>
Nov 08 20:30:14 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:30:14</nova:creationTime>
Nov 08 20:30:14 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:30:14 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:30:14 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:30:14 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:30:14 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:30:14 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:30:14 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:30:14 user nova-compute[74638]:       <nova:owner>
Nov 08 20:30:14 user nova-compute[74638]:         <nova:user uuid="f691961292564fffa7e77b384264c583">tempest-SnapshotDataIntegrityTests-511643886-project-member</nova:user>
Nov 08 20:30:14 user nova-compute[74638]:         <nova:project uuid="77b84dfb76a24be7b4f05798c33f7804">tempest-SnapshotDataIntegrityTests-511643886</nova:project>
Nov 08 20:30:14 user nova-compute[74638]:       </nova:owner>
Nov 08 20:30:14 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:30:14 user nova-compute[74638]:       <nova:ports>
Nov 08 20:30:14 user nova-compute[74638]:         <nova:port uuid="4f3e6fde-c683-4e62-ac4c-92810970fbfb">
Nov 08 20:30:14 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 20:30:14 user nova-compute[74638]:         </nova:port>
Nov 08 20:30:14 user nova-compute[74638]:       </nova:ports>
Nov 08 20:30:14 user nova-compute[74638]:     </nova:instance>
Nov 08 20:30:14 user nova-compute[74638]:   </metadata>
Nov 08 20:30:14 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:30:14 user nova-compute[74638]:     <system>
Nov 08 20:30:14 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:30:14 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:30:14 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:30:14 user nova-compute[74638]:       <entry name="serial">0b409323-6dcf-4395-92ec-1d79b27c515b</entry>
Nov 08 20:30:14 user nova-compute[74638]:       <entry name="uuid">0b409323-6dcf-4395-92ec-1d79b27c515b</entry>
Nov 08 20:30:14 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:30:14 user nova-compute[74638]:     </system>
Nov 08 20:30:14 user nova-compute[74638]:   </sysinfo>
Nov 08 20:30:14 user nova-compute[74638]:   <os>
Nov 08 20:30:14 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:30:14 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:30:14 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:30:14 user nova-compute[74638]:   </os>
Nov 08 20:30:14 user nova-compute[74638]:   <features>
Nov 08 20:30:14 user nova-compute[74638]:     <acpi/>
Nov 08 20:30:14 user nova-compute[74638]:     <apic/>
Nov 08 20:30:14 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:30:14 user nova-compute[74638]:   </features>
Nov 08 20:30:14 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:30:14 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:30:14 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:30:14 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:30:14 user nova-compute[74638]:   </clock>
Nov 08 20:30:14 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:30:14 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:30:14 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:30:14 user nova-compute[74638]:   </cpu>
Nov 08 20:30:14 user nova-compute[74638]:   <devices>
Nov 08 20:30:14 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:30:14 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:30:14 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk"/>
Nov 08 20:30:14 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:30:14 user nova-compute[74638]:     </disk>
Nov 08 20:30:14 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:30:14 user nova-compute[74638]:       <mac address="fa:16:3e:46:07:49"/>
Nov 08 20:30:14 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:30:14 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:30:14 user nova-compute[74638]:       <target dev="tap4f3e6fde-c6"/>
Nov 08 20:30:14 user nova-compute[74638]:     </interface>
Nov 08 20:30:14 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:30:14 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/console.log" append="off"/>
Nov 08 20:30:14 user nova-compute[74638]:     </serial>
Nov 08 20:30:14 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:30:14 user nova-compute[74638]:     <video>
Nov 08 20:30:14 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:30:14 user nova-compute[74638]:     </video>
Nov 08 20:30:14 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:30:14 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:30:14 user nova-compute[74638]:     </rng>
Nov 08 20:30:14 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:30:14 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:30:14 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:30:14 user nova-compute[74638]:     </memballoon>
Nov 08 20:30:14 user nova-compute[74638]:   </devices>
Nov 08 20:30:14 user nova-compute[74638]: </domain>
Nov 08 20:30:14 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1898793169',display_name='tempest-SnapshotDataIntegrityTests-server-1898793169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1898793169',id=35,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGJ4OMVO9CjnqzXjXxTo8JSRgGMBrbgNN8FS8y903Mofdc6Hc3+uhHmeoefq+WcPCxIpGQatPncNMMutoq5wnsuzShqk0LMvVX/SQVf1zfmNwKDH1SCYIk/uW4qy42OIQ==',key_name='tempest-keypair-245506309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77b84dfb76a24be7b4f05798c33f7804',ramdisk_id='',reservation_id='r-9bo263bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-511643886',owner_user_name='tempest-SnapshotDataIntegrityTests-511643886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f691961292564fffa7e77b384264c583',uuid=0b409323-6dcf-4395-92ec-1d79b27c515b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Converting VIF {"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:07:49,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6fde-c683-4e62-ac4c-92810970fbfb,network=Network(e3d53a81-7dda-44fe-85a5-1c9d7c9509f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6fde-c6') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG os_vif [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:07:49,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6fde-c683-4e62-ac4c-92810970fbfb,network=Network(e3d53a81-7dda-44fe-85a5-1c9d7c9509f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6fde-c6') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4c95ee8-4469-537d-a1ef-d25d2e5336b8', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f3e6fde-c6, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f3e6fde-c6, col_values=(('qos', UUID('1ee830bf-0a7d-42e2-af83-ab7c72a54e96')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f3e6fde-c6, col_values=(('external_ids', {'iface-id': '4f3e6fde-c683-4e62-ac4c-92810970fbfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:07:49', 'vm-uuid': '0b409323-6dcf-4395-92ec-1d79b27c515b'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:14 user nova-compute[74638]: INFO os_vif [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:07:49,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6fde-c683-4e62-ac4c-92810970fbfb,network=Network(e3d53a81-7dda-44fe-85a5-1c9d7c9509f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6fde-c6')
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No VIF found with MAC fa:16:3e:46:07:49, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-aa5c3776-035f-4f82-a3bd-c6ced0d6d9bc req-069e3a08-cde6-4c5a-b2d2-4802f5a51c98 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updated VIF entry in instance network info cache for port 4f3e6fde-c683-4e62-ac4c-92810970fbfb. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-aa5c3776-035f-4f82-a3bd-c6ced0d6d9bc req-069e3a08-cde6-4c5a-b2d2-4802f5a51c98 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating instance_info_cache with network_info: [{"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-aa5c3776-035f-4f82-a3bd-c6ced0d6d9bc req-069e3a08-cde6-4c5a-b2d2-4802f5a51c98 service nova] Releasing lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.compute.manager [req-8b6a3639-ed56-4a3c-9aae-e915557adac6 req-fc7911d6-255d-485e-81be-4b6fdf64b472 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-changed-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.compute.manager [req-8b6a3639-ed56-4a3c-9aae-e915557adac6 req-fc7911d6-255d-485e-81be-4b6fdf64b472 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Refreshing instance network info cache due to event network-changed-361e19ab-b526-4a96-9b9a-c7f671bf85be. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8b6a3639-ed56-4a3c-9aae-e915557adac6 req-fc7911d6-255d-485e-81be-4b6fdf64b472 service nova] Acquiring lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8b6a3639-ed56-4a3c-9aae-e915557adac6 req-fc7911d6-255d-485e-81be-4b6fdf64b472 service nova] Acquired lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-8b6a3639-ed56-4a3c-9aae-e915557adac6 req-fc7911d6-255d-485e-81be-4b6fdf64b472 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Refreshing network info cache for port 361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.network.neutron [req-8b6a3639-ed56-4a3c-9aae-e915557adac6 req-fc7911d6-255d-485e-81be-4b6fdf64b472 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updated VIF entry in instance network info cache for port 361e19ab-b526-4a96-9b9a-c7f671bf85be. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.network.neutron [req-8b6a3639-ed56-4a3c-9aae-e915557adac6 req-fc7911d6-255d-485e-81be-4b6fdf64b472 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating instance_info_cache with network_info: [{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:30:15 user nova-compute[74638]: INFO nova.compute.manager [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Detaching volume 1c798879-893e-426d-a40d-f83f94431e04
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8b6a3639-ed56-4a3c-9aae-e915557adac6 req-fc7911d6-255d-485e-81be-4b6fdf64b472 service nova] Releasing lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:15 user nova-compute[74638]: INFO nova.virt.block_device [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Attempting to driver detach volume 1c798879-893e-426d-a40d-f83f94431e04 from mountpoint /dev/vdb
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Attempting to detach device vdb from instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:30:15 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:30:15 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:30:15 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:30:15 user nova-compute[74638]:   <serial>1c798879-893e-426d-a40d-f83f94431e04</serial>
Nov 08 20:30:15 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:30:15 user nova-compute[74638]: </disk>
Nov 08 20:30:15 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:30:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Successfully detached device vdb from instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca from the persistent domain config.
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:30:15 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:30:15 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:30:15 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:30:15 user nova-compute[74638]:   <serial>1c798879-893e-426d-a40d-f83f94431e04</serial>
Nov 08 20:30:15 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:30:15 user nova-compute[74638]: </disk>
Nov 08 20:30:15 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-33495505-622c-4897-8dab-f17f58f2860a req-96822489-6b20-4d6a-90d2-33ad49b71fa6 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received event network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-33495505-622c-4897-8dab-f17f58f2860a req-96822489-6b20-4d6a-90d2-33ad49b71fa6 service nova] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-33495505-622c-4897-8dab-f17f58f2860a req-96822489-6b20-4d6a-90d2-33ad49b71fa6 service nova] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-33495505-622c-4897-8dab-f17f58f2860a req-96822489-6b20-4d6a-90d2-33ad49b71fa6 service nova] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-33495505-622c-4897-8dab-f17f58f2860a req-96822489-6b20-4d6a-90d2-33ad49b71fa6 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] No waiting events found dispatching network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:15 user nova-compute[74638]: WARNING nova.compute.manager [req-33495505-622c-4897-8dab-f17f58f2860a req-96822489-6b20-4d6a-90d2-33ad49b71fa6 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received unexpected event network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb for instance with vm_state building and task_state spawning.
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:30:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-14fad2e9-bb4c-4bde-a4a9-f7b172b13633 req-cd2e83f0-3c13-4b62-9082-7cd2a38507a1 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-changed-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-14fad2e9-bb4c-4bde-a4a9-f7b172b13633 req-cd2e83f0-3c13-4b62-9082-7cd2a38507a1 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Refreshing instance network info cache due to event network-changed-361e19ab-b526-4a96-9b9a-c7f671bf85be. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-14fad2e9-bb4c-4bde-a4a9-f7b172b13633 req-cd2e83f0-3c13-4b62-9082-7cd2a38507a1 service nova] Acquiring lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-14fad2e9-bb4c-4bde-a4a9-f7b172b13633 req-cd2e83f0-3c13-4b62-9082-7cd2a38507a1 service nova] Acquired lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-14fad2e9-bb4c-4bde-a4a9-f7b172b13633 req-cd2e83f0-3c13-4b62-9082-7cd2a38507a1 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Refreshing network info cache for port 361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-2a754189-79db-4a65-a096-70a10e7d8c5c req-ed9bbf44-1cf9-41c1-8d1d-b3ac5432504c service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received event network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2a754189-79db-4a65-a096-70a10e7d8c5c req-ed9bbf44-1cf9-41c1-8d1d-b3ac5432504c service nova] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2a754189-79db-4a65-a096-70a10e7d8c5c req-ed9bbf44-1cf9-41c1-8d1d-b3ac5432504c service nova] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2a754189-79db-4a65-a096-70a10e7d8c5c req-ed9bbf44-1cf9-41c1-8d1d-b3ac5432504c service nova] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-2a754189-79db-4a65-a096-70a10e7d8c5c req-ed9bbf44-1cf9-41c1-8d1d-b3ac5432504c service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] No waiting events found dispatching network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:18 user nova-compute[74638]: WARNING nova.compute.manager [req-2a754189-79db-4a65-a096-70a10e7d8c5c req-ed9bbf44-1cf9-41c1-8d1d-b3ac5432504c service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received unexpected event network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb for instance with vm_state building and task_state spawning.
Nov 08 20:30:18 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:30:18 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8138MB free_disk=25.105236053466797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:18 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Instance spawned successfully.
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:30:18 user nova-compute[74638]: INFO nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Took 6.63 seconds to spawn the instance on the hypervisor.
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance ea1d94b0-c598-4d3b-953b-2822809ef548 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:30:18 user nova-compute[74638]: INFO nova.compute.manager [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Took 7.49 seconds to build instance.
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2117bc4e-fe44-46e1-b191-7dcefc1ae149 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.652s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-14fad2e9-bb4c-4bde-a4a9-f7b172b13633 req-cd2e83f0-3c13-4b62-9082-7cd2a38507a1 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updated VIF entry in instance network info cache for port 361e19ab-b526-4a96-9b9a-c7f671bf85be. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-14fad2e9-bb4c-4bde-a4a9-f7b172b13633 req-cd2e83f0-3c13-4b62-9082-7cd2a38507a1 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating instance_info_cache with network_info: [{"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:30:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-14fad2e9-bb4c-4bde-a4a9-f7b172b13633 req-cd2e83f0-3c13-4b62-9082-7cd2a38507a1 service nova] Releasing lock "refresh_cache-07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:30:19 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:30:19 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:30:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:30:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating instance_info_cache with network_info: [{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:30:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:36 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca is timed out.
Nov 08 20:30:36 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Successfully detached device vdb from instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca from the live domain config.
Nov 08 20:30:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMbyGXLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:30:36 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[48953e54-0e87-4096-96e7-b9612f19b63a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:30:36 user nova-compute[74638]: No targets found.
Nov 08 20:30:36 user nova-compute[74638]: iSNS:
Nov 08 20:30:36 user nova-compute[74638]: No targets found.
Nov 08 20:30:36 user nova-compute[74638]: STATIC:
Nov 08 20:30:36 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:30:36 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:30:36 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:30:36 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04
Nov 08 20:30:36 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:30:36 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:30:36 user nova-compute[74638]: FIRMWARE:
Nov 08 20:30:36 user nova-compute[74638]: No targets found.
Nov 08 20:30:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:30:36 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:30:36 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[165a5f24-86d2-4133-8a07-a286cd31693d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f15ea7-6ee3-4d47-8efb-4be5de7544c1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:30:36 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:30:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:30:36 user nova-compute[74638]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 (non-flash)
Nov 08 20:30:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c1ba710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ee1c91-25c7-4d90-acb3-137b2f8c0f74]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[49180d29-cbce-4435-9f6d-30b8c8d9ab32]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22dc786-0f39-45d1-8033-b55414f5d24c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d201348c-0d27-4b8d-bc2d-d68bf3f90215]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[73af77a7-cc40-4930-9f12-4de77b9abbcd]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ee4b65-6cf5-4827-9f9f-9113928325d8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04, portal: 172.16.0.220,3260]
Nov 08 20:30:36 user nova-compute[74638]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04, portal: 172.16.0.220,3260] successful.
Nov 08 20:30:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c798879-893e-426d-a40d-f83f94431e04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4be3621-d127-46c8-9f6c-358dffb26797]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] <== disconnect_volume: return (301ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:30:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:30:37 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'flavor' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:30:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3601fdb8-384b-42df-a725-e4369a9a7aa6 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.132s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:30:40 user nova-compute[74638]: INFO nova.compute.manager [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] instance snapshotting
Nov 08 20:30:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Beginning live snapshot process
Nov 08 20:30:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json -f qcow2 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json -f qcow2 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp126zjpx/016b262e0c9a4d4f9a28df2336a92e7e.delta 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp126zjpx/016b262e0c9a4d4f9a28df2336a92e7e.delta 1073741824" returned: 0 in 0.053s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 20:30:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:30:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] COPY block job progress, current cursor: 75431936 final cursor: 75497472 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:30:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74638) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 20:30:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 20:30:43 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:30:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp126zjpx/016b262e0c9a4d4f9a28df2336a92e7e.delta /opt/stack/data/nova/instances/snapshots/tmpp126zjpx/016b262e0c9a4d4f9a28df2336a92e7e {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:44 user nova-compute[74638]: INFO nova.compute.manager [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Terminating instance
Nov 08 20:30:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp126zjpx/016b262e0c9a4d4f9a28df2336a92e7e.delta /opt/stack/data/nova/instances/snapshots/tmpp126zjpx/016b262e0c9a4d4f9a28df2336a92e7e" returned: 0 in 0.810s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:30:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Snapshot extracted, beginning image upload
Nov 08 20:30:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-d6454e24-22a1-4681-8efd-74c43d41983a req-85dbb10f-dbeb-4235-979f-741490fc66ce service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-unplugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d6454e24-22a1-4681-8efd-74c43d41983a req-85dbb10f-dbeb-4235-979f-741490fc66ce service nova] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d6454e24-22a1-4681-8efd-74c43d41983a req-85dbb10f-dbeb-4235-979f-741490fc66ce service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d6454e24-22a1-4681-8efd-74c43d41983a req-85dbb10f-dbeb-4235-979f-741490fc66ce service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-d6454e24-22a1-4681-8efd-74c43d41983a req-85dbb10f-dbeb-4235-979f-741490fc66ce service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] No waiting events found dispatching network-vif-unplugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-d6454e24-22a1-4681-8efd-74c43d41983a req-85dbb10f-dbeb-4235-979f-741490fc66ce service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-unplugged-8fdb39c4-229b-4abe-829a-d526f8a9073b for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Instance destroyed successfully.
Nov 08 20:30:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lazy-loading 'resources' on Instance uuid ea1d94b0-c598-4d3b-953b-2822809ef548 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1696281941',display_name='tempest-VolumesActionsTest-instance-1696281941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1696281941',id=34,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:29:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d45047adc05a46db9f719f9d0579c276',ramdisk_id='',reservation_id='r-x1fzfbvy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1038485660',owner_user_name='tempest-VolumesActionsTest-1038485660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:29:01Z,user_data=None,user_id='c3b8411366b341f5936fffed75e319e7',uuid=ea1d94b0-c598-4d3b-953b-2822809ef548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converting VIF {"id": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "address": "fa:16:3e:3a:de:02", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fdb39c4-22", "ovs_interfaceid": "8fdb39c4-229b-4abe-829a-d526f8a9073b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:de:02,bridge_name='br-int',has_traffic_filtering=True,id=8fdb39c4-229b-4abe-829a-d526f8a9073b,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fdb39c4-22') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG os_vif [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:de:02,bridge_name='br-int',has_traffic_filtering=True,id=8fdb39c4-229b-4abe-829a-d526f8a9073b,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fdb39c4-22') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fdb39c4-22, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32a504db-8bde-46db-8b75-67fa454c9193) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:30:45 user nova-compute[74638]: INFO os_vif [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:de:02,bridge_name='br-int',has_traffic_filtering=True,id=8fdb39c4-229b-4abe-829a-d526f8a9073b,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fdb39c4-22')
Nov 08 20:30:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Deleting instance files /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548_del
Nov 08 20:30:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Deletion of /opt/stack/data/nova/instances/ea1d94b0-c598-4d3b-953b-2822809ef548_del complete
Nov 08 20:30:45 user nova-compute[74638]: INFO nova.compute.manager [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 08 20:30:45 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:30:46 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Took 0.77 seconds to deallocate network for instance.
Nov 08 20:30:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-24cca885-b232-42a3-a92d-a9df674b8e2d req-9df7ae59-e075-4d04-af6c-5febb4f85457 service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-deleted-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:46 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:30:46 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:30:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:46 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Deleted allocations for instance ea1d94b0-c598-4d3b-953b-2822809ef548
Nov 08 20:30:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b340d768-c5cd-4d40-951c-fee2a584082a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.207s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] No waiting events found dispatching network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:47 user nova-compute[74638]: WARNING nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received unexpected event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b for instance with vm_state deleted and task_state None.
Nov 08 20:30:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] No waiting events found dispatching network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:47 user nova-compute[74638]: WARNING nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received unexpected event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b for instance with vm_state deleted and task_state None.
Nov 08 20:30:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] No waiting events found dispatching network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:47 user nova-compute[74638]: WARNING nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received unexpected event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b for instance with vm_state deleted and task_state None.
Nov 08 20:30:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Acquiring lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] Lock "ea1d94b0-c598-4d3b-953b-2822809ef548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:30:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] No waiting events found dispatching network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:30:47 user nova-compute[74638]: WARNING nova.compute.manager [req-167b88da-8413-4f9e-a75d-a3f2ccc12b7c req-b4e94843-c167-459d-834c-1c7fec682e7c service nova] [instance: ea1d94b0-c598-4d3b-953b-2822809ef548] Received unexpected event network-vif-plugged-8fdb39c4-229b-4abe-829a-d526f8a9073b for instance with vm_state deleted and task_state None.
Nov 08 20:30:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Snapshot image upload complete
Nov 08 20:30:47 user nova-compute[74638]: INFO nova.compute.manager [None req-b26ad295-446b-4dae-b195-3845f448bb07 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Took 6.83 seconds to snapshot the instance on the hypervisor.
Nov 08 20:30:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:30:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:30:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:30:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:30:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:30:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:05 user nova-compute[74638]: INFO nova.compute.manager [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Terminating instance
Nov 08 20:31:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-18cb3fd9-6b16-4197-8e12-c7003257f103 req-dde41eac-49d9-4309-aedf-3e7eb9c2a74a service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-18cb3fd9-6b16-4197-8e12-c7003257f103 req-dde41eac-49d9-4309-aedf-3e7eb9c2a74a service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-18cb3fd9-6b16-4197-8e12-c7003257f103 req-dde41eac-49d9-4309-aedf-3e7eb9c2a74a service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-18cb3fd9-6b16-4197-8e12-c7003257f103 req-dde41eac-49d9-4309-aedf-3e7eb9c2a74a service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-18cb3fd9-6b16-4197-8e12-c7003257f103 req-dde41eac-49d9-4309-aedf-3e7eb9c2a74a service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:31:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-18cb3fd9-6b16-4197-8e12-c7003257f103 req-dde41eac-49d9-4309-aedf-3e7eb9c2a74a service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-unplugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Instance destroyed successfully.
Nov 08 20:31:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'resources' on Instance uuid 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-78861426',display_name='tempest-ServerRescueNegativeTestJSON-server-78861426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-78861426',id=30,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWLIDNo3A6iC+Rs/V6O8UzxDvXMxbYKelsm2BtuSlovWsQ1nFYlMl3Valso2ECcejx6npl201NCuZCHLJp5xQPV4/sOHn1Cwz36eiJMeZeyW4eReIjVN0Q1qOVkVHXEkQ==',key_name='tempest-keypair-1883717809',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:26:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-0ack4fjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='444c578cebff4167825165a737b5bb85',uuid=07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "address": "fa:16:3e:68:e7:8b", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap361e19ab-b5", "ovs_interfaceid": "361e19ab-b526-4a96-9b9a-c7f671bf85be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:e7:8b,bridge_name='br-int',has_traffic_filtering=True,id=361e19ab-b526-4a96-9b9a-c7f671bf85be,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e19ab-b5') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG os_vif [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:e7:8b,bridge_name='br-int',has_traffic_filtering=True,id=361e19ab-b526-4a96-9b9a-c7f671bf85be,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e19ab-b5') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap361e19ab-b5, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea456361-9f1d-4777-a212-018fbec4bfdb) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:06 user nova-compute[74638]: INFO os_vif [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:e7:8b,bridge_name='br-int',has_traffic_filtering=True,id=361e19ab-b526-4a96-9b9a-c7f671bf85be,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap361e19ab-b5')
Nov 08 20:31:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Deleting instance files /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca_del
Nov 08 20:31:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Deletion of /opt/stack/data/nova/instances/07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca_del complete
Nov 08 20:31:06 user nova-compute[74638]: INFO nova.compute.manager [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 08 20:31:06 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:31:06 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:31:07 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:31:07 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Took 0.93 seconds to deallocate network for instance.
Nov 08 20:31:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-5a731107-e290-49d3-bfc5-b9f8cb51f123 req-63c1f71e-3a4e-47c8-ae03-b300ff0a3780 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-deleted-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:31:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:07 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:31:07 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:31:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-d13dd944-b84a-46b0-812c-5956222c837c req-c4365481-2dd9-4d75-a775-a63e8629fdd9 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:31:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d13dd944-b84a-46b0-812c-5956222c837c req-c4365481-2dd9-4d75-a775-a63e8629fdd9 service nova] Acquiring lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d13dd944-b84a-46b0-812c-5956222c837c req-c4365481-2dd9-4d75-a775-a63e8629fdd9 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d13dd944-b84a-46b0-812c-5956222c837c req-c4365481-2dd9-4d75-a775-a63e8629fdd9 service nova] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-d13dd944-b84a-46b0-812c-5956222c837c req-c4365481-2dd9-4d75-a775-a63e8629fdd9 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] No waiting events found dispatching network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:31:08 user nova-compute[74638]: WARNING nova.compute.manager [req-d13dd944-b84a-46b0-812c-5956222c837c req-c4365481-2dd9-4d75-a775-a63e8629fdd9 service nova] [instance: 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca] Received unexpected event network-vif-plugged-361e19ab-b526-4a96-9b9a-c7f671bf85be for instance with vm_state deleted and task_state None.
Nov 08 20:31:08 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Deleted allocations for instance 07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca
Nov 08 20:31:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-93e4883a-9120-454f-82ca-964b0cd9589e tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "07cb6f97-6c2b-4a20-9a86-4e59ddaa33ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:08 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:31:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:12 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:17 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:31:17 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8311MB free_disk=25.08150863647461GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:31:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:31:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:31:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:19 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:31:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:31:36 user nova-compute[74638]: INFO nova.compute.claims [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Claim successful on node user
Nov 08 20:31:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:31:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:31:36 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:31:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:31:37 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Creating image(s)
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "/opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "/opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG nova.policy [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3b8411366b341f5936fffed75e319e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45047adc05a46db9f719f9d0579c276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk 1073741824" returned: 0 in 0.050s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.220s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Successfully created port: 93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Cannot resize image /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Ensure instance console log exists: /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:38 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Successfully updated port: 93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:31:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "refresh_cache-c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:31:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquired lock "refresh_cache-c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:31:38 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:31:38 user nova-compute[74638]: DEBUG nova.compute.manager [req-939b1011-f7f2-4ba9-906d-502e90843fc4 req-0897ac1d-88df-4358-b118-61bee1967a87 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-changed-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:31:38 user nova-compute[74638]: DEBUG nova.compute.manager [req-939b1011-f7f2-4ba9-906d-502e90843fc4 req-0897ac1d-88df-4358-b118-61bee1967a87 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Refreshing instance network info cache due to event network-changed-93454977-ef9b-4fb2-b4dd-78a1a5890ec9. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:31:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-939b1011-f7f2-4ba9-906d-502e90843fc4 req-0897ac1d-88df-4358-b118-61bee1967a87 service nova] Acquiring lock "refresh_cache-c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:31:38 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Updating instance_info_cache with network_info: [{"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Releasing lock "refresh_cache-c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Instance network_info: |[{"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-939b1011-f7f2-4ba9-906d-502e90843fc4 req-0897ac1d-88df-4358-b118-61bee1967a87 service nova] Acquired lock "refresh_cache-c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.network.neutron [req-939b1011-f7f2-4ba9-906d-502e90843fc4 req-0897ac1d-88df-4358-b118-61bee1967a87 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Refreshing network info cache for port 93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Start _get_guest_xml network_info=[{"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:31:39 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:31:39 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2144409548',display_name='tempest-VolumesActionsTest-instance-2144409548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2144409548',id=36,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d45047adc05a46db9f719f9d0579c276',ramdisk_id='',reservation_id='r-1el5lc7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1038485660',owner_user_name='tempest-VolumesActionsTest-1038485660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:31:37Z,user_data=None,user_id='c3b8411366b341f5936fffed75e319e7',uuid=c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converting VIF {"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=93454977-ef9b-4fb2-b4dd-78a1a5890ec9,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93454977-ef') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.objects.instance [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lazy-loading 'pci_devices' on Instance uuid c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:31:39 user nova-compute[74638]:   <uuid>c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d</uuid>
Nov 08 20:31:39 user nova-compute[74638]:   <name>instance-00000024</name>
Nov 08 20:31:39 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:31:39 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:31:39 user nova-compute[74638]:   <metadata>
Nov 08 20:31:39 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:31:39 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:31:39 user nova-compute[74638]:       <nova:name>tempest-VolumesActionsTest-instance-2144409548</nova:name>
Nov 08 20:31:39 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:31:39</nova:creationTime>
Nov 08 20:31:39 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:31:39 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:31:39 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:31:39 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:31:39 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:31:39 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:31:39 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:31:39 user nova-compute[74638]:       <nova:owner>
Nov 08 20:31:39 user nova-compute[74638]:         <nova:user uuid="c3b8411366b341f5936fffed75e319e7">tempest-VolumesActionsTest-1038485660-project-member</nova:user>
Nov 08 20:31:39 user nova-compute[74638]:         <nova:project uuid="d45047adc05a46db9f719f9d0579c276">tempest-VolumesActionsTest-1038485660</nova:project>
Nov 08 20:31:39 user nova-compute[74638]:       </nova:owner>
Nov 08 20:31:39 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:31:39 user nova-compute[74638]:       <nova:ports>
Nov 08 20:31:39 user nova-compute[74638]:         <nova:port uuid="93454977-ef9b-4fb2-b4dd-78a1a5890ec9">
Nov 08 20:31:39 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:31:39 user nova-compute[74638]:         </nova:port>
Nov 08 20:31:39 user nova-compute[74638]:       </nova:ports>
Nov 08 20:31:39 user nova-compute[74638]:     </nova:instance>
Nov 08 20:31:39 user nova-compute[74638]:   </metadata>
Nov 08 20:31:39 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:31:39 user nova-compute[74638]:     <system>
Nov 08 20:31:39 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:31:39 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:31:39 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:31:39 user nova-compute[74638]:       <entry name="serial">c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d</entry>
Nov 08 20:31:39 user nova-compute[74638]:       <entry name="uuid">c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d</entry>
Nov 08 20:31:39 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:31:39 user nova-compute[74638]:     </system>
Nov 08 20:31:39 user nova-compute[74638]:   </sysinfo>
Nov 08 20:31:39 user nova-compute[74638]:   <os>
Nov 08 20:31:39 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:31:39 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:31:39 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:31:39 user nova-compute[74638]:   </os>
Nov 08 20:31:39 user nova-compute[74638]:   <features>
Nov 08 20:31:39 user nova-compute[74638]:     <acpi/>
Nov 08 20:31:39 user nova-compute[74638]:     <apic/>
Nov 08 20:31:39 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:31:39 user nova-compute[74638]:   </features>
Nov 08 20:31:39 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:31:39 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:31:39 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:31:39 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:31:39 user nova-compute[74638]:   </clock>
Nov 08 20:31:39 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:31:39 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:31:39 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:31:39 user nova-compute[74638]:   </cpu>
Nov 08 20:31:39 user nova-compute[74638]:   <devices>
Nov 08 20:31:39 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:31:39 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:31:39 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk"/>
Nov 08 20:31:39 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:31:39 user nova-compute[74638]:     </disk>
Nov 08 20:31:39 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:31:39 user nova-compute[74638]:       <mac address="fa:16:3e:60:0b:df"/>
Nov 08 20:31:39 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:31:39 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:31:39 user nova-compute[74638]:       <target dev="tap93454977-ef"/>
Nov 08 20:31:39 user nova-compute[74638]:     </interface>
Nov 08 20:31:39 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:31:39 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/console.log" append="off"/>
Nov 08 20:31:39 user nova-compute[74638]:     </serial>
Nov 08 20:31:39 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:31:39 user nova-compute[74638]:     <video>
Nov 08 20:31:39 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:31:39 user nova-compute[74638]:     </video>
Nov 08 20:31:39 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:31:39 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:31:39 user nova-compute[74638]:     </rng>
Nov 08 20:31:39 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:31:39 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:31:39 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:31:39 user nova-compute[74638]:     </memballoon>
Nov 08 20:31:39 user nova-compute[74638]:   </devices>
Nov 08 20:31:39 user nova-compute[74638]: </domain>
Nov 08 20:31:39 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2144409548',display_name='tempest-VolumesActionsTest-instance-2144409548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2144409548',id=36,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d45047adc05a46db9f719f9d0579c276',ramdisk_id='',reservation_id='r-1el5lc7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1038485660',owner_user_name='tempest-VolumesActionsTest-1038485660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:31:37Z,user_data=None,user_id='c3b8411366b341f5936fffed75e319e7',uuid=c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converting VIF {"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=93454977-ef9b-4fb2-b4dd-78a1a5890ec9,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93454977-ef') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG os_vif [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=93454977-ef9b-4fb2-b4dd-78a1a5890ec9,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93454977-ef') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f57599a3-3dd6-5c52-81f5-0f53db70b1ff', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93454977-ef, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93454977-ef, col_values=(('qos', UUID('f230ce9a-1ce5-43cf-a7bf-dbdb20e3ad54')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93454977-ef, col_values=(('external_ids', {'iface-id': '93454977-ef9b-4fb2-b4dd-78a1a5890ec9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:0b:df', 'vm-uuid': 'c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:39 user nova-compute[74638]: INFO os_vif [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=93454977-ef9b-4fb2-b4dd-78a1a5890ec9,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93454977-ef')
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] No VIF found with MAC fa:16:3e:60:0b:df, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.network.neutron [req-939b1011-f7f2-4ba9-906d-502e90843fc4 req-0897ac1d-88df-4358-b118-61bee1967a87 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Updated VIF entry in instance network info cache for port 93454977-ef9b-4fb2-b4dd-78a1a5890ec9. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG nova.network.neutron [req-939b1011-f7f2-4ba9-906d-502e90843fc4 req-0897ac1d-88df-4358-b118-61bee1967a87 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Updating instance_info_cache with network_info: [{"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:31:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-939b1011-f7f2-4ba9-906d-502e90843fc4 req-0897ac1d-88df-4358-b118-61bee1967a87 service nova] Releasing lock "refresh_cache-c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:31:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-0de2a5a2-0918-4d85-bd03-4fa8e0205d23 req-b6ac08e7-c89f-4442-9c1c-72a7a292bb65 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:31:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0de2a5a2-0918-4d85-bd03-4fa8e0205d23 req-b6ac08e7-c89f-4442-9c1c-72a7a292bb65 service nova] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0de2a5a2-0918-4d85-bd03-4fa8e0205d23 req-b6ac08e7-c89f-4442-9c1c-72a7a292bb65 service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0de2a5a2-0918-4d85-bd03-4fa8e0205d23 req-b6ac08e7-c89f-4442-9c1c-72a7a292bb65 service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-0de2a5a2-0918-4d85-bd03-4fa8e0205d23 req-b6ac08e7-c89f-4442-9c1c-72a7a292bb65 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] No waiting events found dispatching network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:31:41 user nova-compute[74638]: WARNING nova.compute.manager [req-0de2a5a2-0918-4d85-bd03-4fa8e0205d23 req-b6ac08e7-c89f-4442-9c1c-72a7a292bb65 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received unexpected event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 for instance with vm_state building and task_state spawning.
Nov 08 20:31:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:31:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Instance spawned successfully.
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:31:43 user nova-compute[74638]: INFO nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:31:43 user nova-compute[74638]: INFO nova.compute.manager [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Took 6.79 seconds to build instance.
Nov 08 20:31:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bd8fe9b5-adec-4d65-a10b-84c71c32549a tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.946s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-9de6ecf2-ecdd-434d-90b9-67aca649bb64 req-d85e6348-64ae-4be7-9845-16a0fd9bb0c9 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9de6ecf2-ecdd-434d-90b9-67aca649bb64 req-d85e6348-64ae-4be7-9845-16a0fd9bb0c9 service nova] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9de6ecf2-ecdd-434d-90b9-67aca649bb64 req-d85e6348-64ae-4be7-9845-16a0fd9bb0c9 service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9de6ecf2-ecdd-434d-90b9-67aca649bb64 req-d85e6348-64ae-4be7-9845-16a0fd9bb0c9 service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-9de6ecf2-ecdd-434d-90b9-67aca649bb64 req-d85e6348-64ae-4be7-9845-16a0fd9bb0c9 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] No waiting events found dispatching network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:31:43 user nova-compute[74638]: WARNING nova.compute.manager [req-9de6ecf2-ecdd-434d-90b9-67aca649bb64 req-d85e6348-64ae-4be7-9845-16a0fd9bb0c9 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received unexpected event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 for instance with vm_state active and task_state None.
Nov 08 20:31:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:31:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:31:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:31:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:31:50 user nova-compute[74638]: INFO nova.compute.claims [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Claim successful on node user
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:31:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:31:50 user nova-compute[74638]: DEBUG nova.policy [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ab02946569c47ff9772753454afc5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d69c08c247c41cd842c3673cf9af390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:31:50 user nova-compute[74638]: INFO nova.virt.block_device [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Booting with volume-backed-image 2378b081-1a49-4717-81bb-a291ba1a9d32 at /dev/vda
Nov 08 20:31:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Successfully created port: d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Successfully updated port: d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquired lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-8a47394f-73c4-4229-a163-889f28ed704a req-94b64f6b-ab17-4189-b6dc-cfe66a23b73c service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-changed-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-8a47394f-73c4-4229-a163-889f28ed704a req-94b64f6b-ab17-4189-b6dc-cfe66a23b73c service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Refreshing instance network info cache due to event network-changed-d6116299-160a-41e6-87ee-94c985529c3f. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8a47394f-73c4-4229-a163-889f28ed704a req-94b64f6b-ab17-4189-b6dc-cfe66a23b73c service nova] Acquiring lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Updating instance_info_cache with network_info: [{"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Releasing lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance network_info: |[{"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8a47394f-73c4-4229-a163-889f28ed704a req-94b64f6b-ab17-4189-b6dc-cfe66a23b73c service nova] Acquired lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-8a47394f-73c4-4229-a163-889f28ed704a req-94b64f6b-ab17-4189-b6dc-cfe66a23b73c service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Refreshing network info cache for port d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-8a47394f-73c4-4229-a163-889f28ed704a req-94b64f6b-ab17-4189-b6dc-cfe66a23b73c service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Updated VIF entry in instance network info cache for port d6116299-160a-41e6-87ee-94c985529c3f. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-8a47394f-73c4-4229-a163-889f28ed704a req-94b64f6b-ab17-4189-b6dc-cfe66a23b73c service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Updating instance_info_cache with network_info: [{"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:31:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8a47394f-73c4-4229-a163-889f28ed704a req-94b64f6b-ab17-4189-b6dc-cfe66a23b73c service nova] Releasing lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:31:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:31:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:31:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:31:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:31:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:58 user nova-compute[74638]: INFO nova.compute.manager [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Unshelving
Nov 08 20:31:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:31:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:31:59 user nova-compute[74638]: DEBUG nova.objects.instance [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'pci_requests' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:31:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:59 user nova-compute[74638]: DEBUG nova.objects.instance [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'numa_topology' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:31:59 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:31:59 user nova-compute[74638]: INFO nova.compute.claims [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Claim successful on node user
Nov 08 20:31:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:31:59 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:31:59 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:31:59 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:31:59 user nova-compute[74638]: INFO nova.network.neutron [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating port eb11383c-4b16-4824-bfff-4eedb2dcda08 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquired lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG nova.network.neutron [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ea6fc9f-b44f-41df-b7a7-a90e67e93f92 req-2598dc98-3765-4d86-87ea-f6f7f48ad853 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-changed-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ea6fc9f-b44f-41df-b7a7-a90e67e93f92 req-2598dc98-3765-4d86-87ea-f6f7f48ad853 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Refreshing instance network info cache due to event network-changed-eb11383c-4b16-4824-bfff-4eedb2dcda08. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ea6fc9f-b44f-41df-b7a7-a90e67e93f92 req-2598dc98-3765-4d86-87ea-f6f7f48ad853 service nova] Acquiring lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG nova.network.neutron [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating instance_info_cache with network_info: [{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Releasing lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:32:00 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Creating image(s)
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG nova.objects.instance [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ea6fc9f-b44f-41df-b7a7-a90e67e93f92 req-2598dc98-3765-4d86-87ea-f6f7f48ad853 service nova] Acquired lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ea6fc9f-b44f-41df-b7a7-a90e67e93f92 req-2598dc98-3765-4d86-87ea-f6f7f48ad853 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Refreshing network info cache for port eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG nova.objects.base [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<5403e126-4e0c-457f-9498-f30c802e4221> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "06f2bc14927e5cf5aaf0a9d35927e189f4a51156" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "06f2bc14927e5cf5aaf0a9d35927e189f4a51156" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156.part --force-share --output=json" returned: 0 in 0.258s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG nova.virt.images [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] fb147b7f-880f-4033-ad5b-16cb3867c3d1 was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156.part /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG nova.compute.manager [req-fc002d61-20e9-41d1-87dc-5d5f2a339a08 req-59234369-f272-4d2c-820c-f2dfbe157aaf service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received event network-changed-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG nova.compute.manager [req-fc002d61-20e9-41d1-87dc-5d5f2a339a08 req-59234369-f272-4d2c-820c-f2dfbe157aaf service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Refreshing instance network info cache due to event network-changed-4f3e6fde-c683-4e62-ac4c-92810970fbfb. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fc002d61-20e9-41d1-87dc-5d5f2a339a08 req-59234369-f272-4d2c-820c-f2dfbe157aaf service nova] Acquiring lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fc002d61-20e9-41d1-87dc-5d5f2a339a08 req-59234369-f272-4d2c-820c-f2dfbe157aaf service nova] Acquired lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG nova.network.neutron [req-fc002d61-20e9-41d1-87dc-5d5f2a339a08 req-59234369-f272-4d2c-820c-f2dfbe157aaf service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Refreshing network info cache for port 4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ea6fc9f-b44f-41df-b7a7-a90e67e93f92 req-2598dc98-3765-4d86-87ea-f6f7f48ad853 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updated VIF entry in instance network info cache for port eb11383c-4b16-4824-bfff-4eedb2dcda08. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG nova.network.neutron [req-1ea6fc9f-b44f-41df-b7a7-a90e67e93f92 req-2598dc98-3765-4d86-87ea-f6f7f48ad853 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating instance_info_cache with network_info: [{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ea6fc9f-b44f-41df-b7a7-a90e67e93f92 req-2598dc98-3765-4d86-87ea-f6f7f48ad853 service nova] Releasing lock "refresh_cache-5403e126-4e0c-457f-9498-f30c802e4221" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156.part /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156.converted" returned: 0 in 0.416s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "06f2bc14927e5cf5aaf0a9d35927e189f4a51156" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.154s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156 --force-share --output=json" returned: 0 in 0.188s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "06f2bc14927e5cf5aaf0a9d35927e189f4a51156" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "06f2bc14927e5cf5aaf0a9d35927e189f4a51156" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156 --force-share --output=json" returned: 0 in 0.172s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156,backing_fmt=raw /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156,backing_fmt=raw /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk 1073741824" returned: 0 in 0.051s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "06f2bc14927e5cf5aaf0a9d35927e189f4a51156" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156 --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG nova.objects.instance [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'migration_context' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG nova.objects.base [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<5403e126-4e0c-457f-9498-f30c802e4221> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:32:03 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Rebasing disk image.
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG nova.network.neutron [req-fc002d61-20e9-41d1-87dc-5d5f2a339a08 req-59234369-f272-4d2c-820c-f2dfbe157aaf service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updated VIF entry in instance network info cache for port 4f3e6fde-c683-4e62-ac4c-92810970fbfb. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG nova.network.neutron [req-fc002d61-20e9-41d1-87dc-5d5f2a339a08 req-59234369-f272-4d2c-820c-f2dfbe157aaf service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating instance_info_cache with network_info: [{"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fc002d61-20e9-41d1-87dc-5d5f2a339a08 req-59234369-f272-4d2c-820c-f2dfbe157aaf service nova] Releasing lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 -F raw /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:03 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:04 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 -F raw /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk" returned: 0 in 2.528s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Ensure instance console log exists: /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Start _get_guest_xml network_info=[{"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='48013ed9f7fc842bbdc245486cce4d61',container_format='bare',created_at=2023-11-08T20:30:06Z,direct_url=<?>,disk_format='qcow2',id=fb147b7f-880f-4033-ad5b-16cb3867c3d1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1699605769-shelved',owner='ad76637f4c184691893fc1c41cb6d08c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T20:30:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:32:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:32:06 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='48013ed9f7fc842bbdc245486cce4d61',container_format='bare',created_at=2023-11-08T20:30:06Z,direct_url=<?>,disk_format='qcow2',id=fb147b7f-880f-4033-ad5b-16cb3867c3d1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1699605769-shelved',owner='ad76637f4c184691893fc1c41cb6d08c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T20:30:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.objects.base [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<5403e126-4e0c-457f-9498-f30c802e4221> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1699605769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1699605769',id=32,image_ref='fb147b7f-880f-4033-ad5b-16cb3867c3d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2077397320',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-m0ncmvqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member',shelved_at='2023-11-08T20:30:11.173024',shelved_host='user',shelved_image_id='fb147b7f-880f-4033-ad5b-16cb3867c3d1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=5403e126-4e0c-457f-9498-f30c802e4221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'pci_devices' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.objects.base [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Object Instance<5403e126-4e0c-457f-9498-f30c802e4221> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:32:06 user nova-compute[74638]:   <uuid>5403e126-4e0c-457f-9498-f30c802e4221</uuid>
Nov 08 20:32:06 user nova-compute[74638]:   <name>instance-00000020</name>
Nov 08 20:32:06 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:32:06 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:32:06 user nova-compute[74638]:   <metadata>
Nov 08 20:32:06 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:32:06 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:32:06 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1699605769</nova:name>
Nov 08 20:32:06 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:32:06</nova:creationTime>
Nov 08 20:32:06 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:32:06 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:32:06 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:32:06 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:32:06 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:32:06 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:32:06 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:32:06 user nova-compute[74638]:       <nova:owner>
Nov 08 20:32:06 user nova-compute[74638]:         <nova:user uuid="e5d2a2e56dfc441ea12bfe9a89527a2d">tempest-AttachVolumeShelveTestJSON-1349495348-project-member</nova:user>
Nov 08 20:32:06 user nova-compute[74638]:         <nova:project uuid="ad76637f4c184691893fc1c41cb6d08c">tempest-AttachVolumeShelveTestJSON-1349495348</nova:project>
Nov 08 20:32:06 user nova-compute[74638]:       </nova:owner>
Nov 08 20:32:06 user nova-compute[74638]:       <nova:root type="image" uuid="fb147b7f-880f-4033-ad5b-16cb3867c3d1"/>
Nov 08 20:32:06 user nova-compute[74638]:       <nova:ports>
Nov 08 20:32:06 user nova-compute[74638]:         <nova:port uuid="eb11383c-4b16-4824-bfff-4eedb2dcda08">
Nov 08 20:32:06 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:32:06 user nova-compute[74638]:         </nova:port>
Nov 08 20:32:06 user nova-compute[74638]:       </nova:ports>
Nov 08 20:32:06 user nova-compute[74638]:     </nova:instance>
Nov 08 20:32:06 user nova-compute[74638]:   </metadata>
Nov 08 20:32:06 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:32:06 user nova-compute[74638]:     <system>
Nov 08 20:32:06 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:32:06 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:32:06 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:32:06 user nova-compute[74638]:       <entry name="serial">5403e126-4e0c-457f-9498-f30c802e4221</entry>
Nov 08 20:32:06 user nova-compute[74638]:       <entry name="uuid">5403e126-4e0c-457f-9498-f30c802e4221</entry>
Nov 08 20:32:06 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:32:06 user nova-compute[74638]:     </system>
Nov 08 20:32:06 user nova-compute[74638]:   </sysinfo>
Nov 08 20:32:06 user nova-compute[74638]:   <os>
Nov 08 20:32:06 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:32:06 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:32:06 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:32:06 user nova-compute[74638]:   </os>
Nov 08 20:32:06 user nova-compute[74638]:   <features>
Nov 08 20:32:06 user nova-compute[74638]:     <acpi/>
Nov 08 20:32:06 user nova-compute[74638]:     <apic/>
Nov 08 20:32:06 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:32:06 user nova-compute[74638]:   </features>
Nov 08 20:32:06 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:32:06 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:32:06 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:32:06 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:32:06 user nova-compute[74638]:   </clock>
Nov 08 20:32:06 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:32:06 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:32:06 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:32:06 user nova-compute[74638]:   </cpu>
Nov 08 20:32:06 user nova-compute[74638]:   <devices>
Nov 08 20:32:06 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:32:06 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:32:06 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk"/>
Nov 08 20:32:06 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:32:06 user nova-compute[74638]:     </disk>
Nov 08 20:32:06 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:32:06 user nova-compute[74638]:       <mac address="fa:16:3e:a2:66:37"/>
Nov 08 20:32:06 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:32:06 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:32:06 user nova-compute[74638]:       <target dev="tapeb11383c-4b"/>
Nov 08 20:32:06 user nova-compute[74638]:     </interface>
Nov 08 20:32:06 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:32:06 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/console.log" append="off"/>
Nov 08 20:32:06 user nova-compute[74638]:     </serial>
Nov 08 20:32:06 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:32:06 user nova-compute[74638]:     <video>
Nov 08 20:32:06 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:32:06 user nova-compute[74638]:     </video>
Nov 08 20:32:06 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:32:06 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:32:06 user nova-compute[74638]:     </rng>
Nov 08 20:32:06 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:32:06 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:32:06 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:32:06 user nova-compute[74638]:     </memballoon>
Nov 08 20:32:06 user nova-compute[74638]:   </devices>
Nov 08 20:32:06 user nova-compute[74638]: </domain>
Nov 08 20:32:06 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1699605769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1699605769',id=32,image_ref='fb147b7f-880f-4033-ad5b-16cb3867c3d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2077397320',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-m0ncmvqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member',shelved_at='2023-11-08T20:30:11.173024',shelved_host='user',shelved_image_id='fb147b7f-880f-4033-ad5b-16cb3867c3d1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=5403e126-4e0c-457f-9498-f30c802e4221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG os_vif [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '219e8ac9-69b3-5249-bf64-3d6818725c62', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb11383c-4b, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb11383c-4b, col_values=(('qos', UUID('3d35d70c-ab0c-4326-9f0f-ce94f9cf508d')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb11383c-4b, col_values=(('external_ids', {'iface-id': 'eb11383c-4b16-4824-bfff-4eedb2dcda08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:66:37', 'vm-uuid': '5403e126-4e0c-457f-9498-f30c802e4221'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:06 user nova-compute[74638]: INFO os_vif [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b')
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] No VIF found with MAC fa:16:3e:a2:66:37, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:32:06 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-02962c88-9145-4294-a888-0ebc77932e5d req-912fc205-9000-4381-90ba-8ec4af262edc service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:32:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-02962c88-9145-4294-a888-0ebc77932e5d req-912fc205-9000-4381-90ba-8ec4af262edc service nova] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-02962c88-9145-4294-a888-0ebc77932e5d req-912fc205-9000-4381-90ba-8ec4af262edc service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-02962c88-9145-4294-a888-0ebc77932e5d req-912fc205-9000-4381-90ba-8ec4af262edc service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-02962c88-9145-4294-a888-0ebc77932e5d req-912fc205-9000-4381-90ba-8ec4af262edc service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] No waiting events found dispatching network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:32:08 user nova-compute[74638]: WARNING nova.compute.manager [req-02962c88-9145-4294-a888-0ebc77932e5d req-912fc205-9000-4381-90ba-8ec4af262edc service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received unexpected event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 20:32:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:09 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:32:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance spawned successfully.
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:10 user nova-compute[74638]: INFO nova.compute.manager [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attaching volume 444f58ed-2713-489b-919b-24d4dec89a70 to /dev/vdb
Nov 08 20:32:10 user nova-compute[74638]: DEBUG nova.compute.manager [req-9110fa62-b51a-4235-b122-3a07442de684 req-563665df-f6f2-43ab-960f-42e56a548455 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9110fa62-b51a-4235-b122-3a07442de684 req-563665df-f6f2-43ab-960f-42e56a548455 service nova] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9110fa62-b51a-4235-b122-3a07442de684 req-563665df-f6f2-43ab-960f-42e56a548455 service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9110fa62-b51a-4235-b122-3a07442de684 req-563665df-f6f2-43ab-960f-42e56a548455 service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG nova.compute.manager [req-9110fa62-b51a-4235-b122-3a07442de684 req-563665df-f6f2-43ab-960f-42e56a548455 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] No waiting events found dispatching network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:32:10 user nova-compute[74638]: WARNING nova.compute.manager [req-9110fa62-b51a-4235-b122-3a07442de684 req-563665df-f6f2-43ab-960f-42e56a548455 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received unexpected event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 20:32:10 user nova-compute[74638]: DEBUG os_brick.utils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e788e24-1927-41ba-81e4-67a370d5864d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b9019-12fc-435c-8fe0-33fea0a6f444]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11e0332-94aa-4ca6-a2fa-5e46e7641ae3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de692ce-9b90-4ec3-a61a-25f8a556d425]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:32:10 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ca7db2-0eda-4727-884f-b3d0b39b3318]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG os_brick.utils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating existing volume attachment record: eb0d7f15-d20e-435e-ba31-231bc067826c {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:32:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-44bfea0b-066b-44dc-b0d7-a0cff95fad25 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.734s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:11 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:13 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:14 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:32:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:18 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:32:18 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:32:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8212MB free_disk=25.016464233398438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:32:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 862f8350-1466-4fec-b58b-2d7bd2ee8579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9f955212-6cf6-4f51-944a-5a3482082fda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5403e126-4e0c-457f-9498-f30c802e4221 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.916s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:32:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Skipping network cache update for instance because it is Building. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:32:20 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updating instance_info_cache with network_info: [{"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-862f8350-1466-4fec-b58b-2d7bd2ee8579" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "9f955212-6cf6-4f51-944a-5a3482082fda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:21 user nova-compute[74638]: INFO nova.compute.manager [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Terminating instance
Nov 08 20:32:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:32:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-b50d44e9-50a4-4865-acb4-866c4d0d489b req-3e70ab90-f827-410a-9679-97bf22aad46f service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-unplugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b50d44e9-50a4-4865-acb4-866c4d0d489b req-3e70ab90-f827-410a-9679-97bf22aad46f service nova] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b50d44e9-50a4-4865-acb4-866c4d0d489b req-3e70ab90-f827-410a-9679-97bf22aad46f service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b50d44e9-50a4-4865-acb4-866c4d0d489b req-3e70ab90-f827-410a-9679-97bf22aad46f service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-b50d44e9-50a4-4865-acb4-866c4d0d489b req-3e70ab90-f827-410a-9679-97bf22aad46f service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] No waiting events found dispatching network-vif-unplugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-b50d44e9-50a4-4865-acb4-866c4d0d489b req-3e70ab90-f827-410a-9679-97bf22aad46f service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-unplugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:22 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Instance destroyed successfully.
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.objects.instance [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'resources' on Instance uuid 9f955212-6cf6-4f51-944a-5a3482082fda {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-84924301',display_name='tempest-ServerRescueNegativeTestJSON-server-84924301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-84924301',id=19,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-kgkrpcj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:16:38Z,user_data=None,user_id='444c578cebff4167825165a737b5bb85',uuid=9f955212-6cf6-4f51-944a-5a3482082fda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "address": "fa:16:3e:c4:59:0a", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd23059b2-a4", "ovs_interfaceid": "d23059b2-a4de-4b0f-8434-f4ff2e88f927", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=d23059b2-a4de-4b0f-8434-f4ff2e88f927,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23059b2-a4') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG os_vif [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=d23059b2-a4de-4b0f-8434-f4ff2e88f927,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23059b2-a4') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd23059b2-a4, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5ad47b7-cbc5-47e7-826e-56c4e11b6a97) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:32:22 user nova-compute[74638]: INFO os_vif [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:59:0a,bridge_name='br-int',has_traffic_filtering=True,id=d23059b2-a4de-4b0f-8434-f4ff2e88f927,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd23059b2-a4')
Nov 08 20:32:22 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Deleting instance files /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda_del
Nov 08 20:32:22 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Deletion of /opt/stack/data/nova/instances/9f955212-6cf6-4f51-944a-5a3482082fda_del complete
Nov 08 20:32:22 user nova-compute[74638]: INFO nova.compute.manager [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 08 20:32:22 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:32:22 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:32:23 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:32:23 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Took 0.50 seconds to deallocate network for instance.
Nov 08 20:32:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-497314bd-e3b9-45de-bed8-d3720b0a174c req-fe70ebcf-f855-4fe9-beec-bbcbc4325570 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-deleted-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:32:23 user nova-compute[74638]: INFO nova.compute.manager [req-497314bd-e3b9-45de-bed8-d3720b0a174c req-fe70ebcf-f855-4fe9-beec-bbcbc4325570 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Neutron deleted interface d23059b2-a4de-4b0f-8434-f4ff2e88f927; detaching it from the instance and deleting it from the info cache
Nov 08 20:32:23 user nova-compute[74638]: DEBUG nova.network.neutron [req-497314bd-e3b9-45de-bed8-d3720b0a174c req-fe70ebcf-f855-4fe9-beec-bbcbc4325570 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:32:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-497314bd-e3b9-45de-bed8-d3720b0a174c req-fe70ebcf-f855-4fe9-beec-bbcbc4325570 service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Detach interface failed, port_id=d23059b2-a4de-4b0f-8434-f4ff2e88f927, reason: Instance 9f955212-6cf6-4f51-944a-5a3482082fda could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:32:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:23 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:32:23 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:32:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:23 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Deleted allocations for instance 9f955212-6cf6-4f51-944a-5a3482082fda
Nov 08 20:32:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-425cb6b4-c2d8-49e4-a874-826977a7c44b tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "9f955212-6cf6-4f51-944a-5a3482082fda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-9085119d-35df-4513-8b20-ff438557bb5f req-14f53a52-c6fc-44e5-8ee9-0b88fbfcb7ce service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:32:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9085119d-35df-4513-8b20-ff438557bb5f req-14f53a52-c6fc-44e5-8ee9-0b88fbfcb7ce service nova] Acquiring lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9085119d-35df-4513-8b20-ff438557bb5f req-14f53a52-c6fc-44e5-8ee9-0b88fbfcb7ce service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9085119d-35df-4513-8b20-ff438557bb5f req-14f53a52-c6fc-44e5-8ee9-0b88fbfcb7ce service nova] Lock "9f955212-6cf6-4f51-944a-5a3482082fda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-9085119d-35df-4513-8b20-ff438557bb5f req-14f53a52-c6fc-44e5-8ee9-0b88fbfcb7ce service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] No waiting events found dispatching network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:32:24 user nova-compute[74638]: WARNING nova.compute.manager [req-9085119d-35df-4513-8b20-ff438557bb5f req-14f53a52-c6fc-44e5-8ee9-0b88fbfcb7ce service nova] [instance: 9f955212-6cf6-4f51-944a-5a3482082fda] Received unexpected event network-vif-plugged-d23059b2-a4de-4b0f-8434-f4ff2e88f927 for instance with vm_state deleted and task_state None.
Nov 08 20:32:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQTbifjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:32:35 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:32:35 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:32:35 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c65ac-ee26-48cd-a03a-776be96032ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:32:35 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e14716-0512-4858-a10d-1d95bfccb31d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70] added
Nov 08 20:32:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb7096-4da7-4852-8e7c-469ffe86d790]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8695fe85-3844-4fae-b041-111c72841b12]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQTbifjC {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lQTbifjC" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea2965-241e-4f0d-a621-15ed52f532e2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lQTbifjC'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[923258df-2989-4f5c-aaa1-131b743bece8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4478f5-3d81-4fb4-b2b9-9d909d2891a3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:32:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:32:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dfdf62-2b65-4a21-85b4-865728982115]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70, portal: 172.16.0.220,3260]
Nov 08 20:32:35 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70, portal: 172.16.0.220,3260] successful.
Nov 08 20:32:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15c5073-52c9-4bcd-be0b-132db247b834]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd36d2f-1dc7-424f-8d39-18a5d7470ec6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:32:36 user nova-compute[74638]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)
Nov 08 20:32:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:32:36 user nova-compute[74638]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)
Nov 08 20:32:36 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d442c-45d4-4c5d-a3f9-c4f5cdf9381b]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:32:36 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQTbifjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26565306539346435', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565306539346435', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:32:37 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:32:37 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:32:37 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:32:37 user nova-compute[74638]:   <serial>444f58ed-2713-489b-919b-24d4dec89a70</serial>
Nov 08 20:32:37 user nova-compute[74638]: </disk>
Nov 08 20:32:37 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No VIF found with MAC fa:16:3e:46:07:49, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0e90f9e6-8173-4a18-a5f9-7d43d124c4fd tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.355s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG os_brick.utils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b927c6c9-8313-4bde-b08a-b6dd0c4ec7cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[819d6b97-6b82-44c5-9e2f-9043a0638af5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3d9f0-9c45-4dbf-ac09-7d470461843d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff542fa0-efdd-4b7f-848c-0323ab2549fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:32:37 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:32:37 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25dbf25-92e1-4fc4-99cf-0d9487bf5092]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG os_brick.utils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:32:37 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Updating existing volume attachment record: 1f294173-e7ac-4348-90bc-c4c443e9e384 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:32:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:32:49 user nova-compute[74638]: WARNING nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Nov 08 20:32:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 9c01852a-a4a9-48d9-a6f2-c74a31643837 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:32:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "5403e126-4e0c-457f-9498-f30c802e4221" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:32:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "5403e126-4e0c-457f-9498-f30c802e4221" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:32:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:32:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:32:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:32:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:32:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:32:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:33:02 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Creating image(s)
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Ensure instance console log exists: /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Start _get_guest_xml network_info=[{"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1f294173-e7ac-4348-90bc-c4c443e9e384', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIxiCOTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '685b6be0-e0d5-4af0-bdbc-699b96f5eef8', 'attached_at': '', 'detached_at': '', 'volume_id': '2acc1d1e-821b-43eb-8311-507adb61c557', 'serial': '2acc1d1e-821b-43eb-8311-507adb61c557'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:33:02 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:33:02 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIxiCOTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:33:02 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:33:02 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:33:02 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee851b5e-fc44-4953-8a0b-05237a53d28b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:33:02 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8254052-0410-4006-bced-7ff31e07359f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557] added
Nov 08 20:33:02 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a5a90-d6fb-4b17-a5ea-9271de1c4d4b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b658e0f5-6b31-40fa-9497-e184dd71e488]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIxiCOTn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIxiCOTn" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2505cd92-4fa6-411c-9308-7fc48051bc6d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mIxiCOTn'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:02 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce41996-ddff-4f3e-9eda-0dac586ffde6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca356a1e-2ffa-4cb8-b3ec-a8f0ba9cccb5]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:33:03 user nova-compute[74638]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)
Nov 08 20:33:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:33:03 user nova-compute[74638]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)
Nov 08 20:33:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193ed34-eeed-44d6-8eb7-89f6d288dc35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557, portal: 172.16.0.220,3260]
Nov 08 20:33:03 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557, portal: 172.16.0.220,3260] successful.
Nov 08 20:33:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24eb32d-192a-4509-b074-497e4fbd59f0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2815d32-9c03-4529-8835-0f1b1b91e83f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:33:03 user nova-compute[74638]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)
Nov 08 20:33:03 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:33:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:33:03 user nova-compute[74638]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)
Nov 08 20:33:03 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:33:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3ff13e-bc02-4240-8ced-3608dcd89cb8]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:33:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIxiCOTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23165363737353266', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165363737353266', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-977664027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-977664027',id=37,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-rpbixtgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:31:51Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=685b6be0-e0d5-4af0-bdbc-699b96f5eef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c0:92,bridge_name='br-int',has_traffic_filtering=True,id=d6116299-160a-41e6-87ee-94c985529c3f,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6116299-16') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.objects.instance [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'pci_devices' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:33:04 user nova-compute[74638]:   <uuid>685b6be0-e0d5-4af0-bdbc-699b96f5eef8</uuid>
Nov 08 20:33:04 user nova-compute[74638]:   <name>instance-00000025</name>
Nov 08 20:33:04 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:33:04 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:33:04 user nova-compute[74638]:   <metadata>
Nov 08 20:33:04 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:33:04 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:33:04 user nova-compute[74638]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-977664027</nova:name>
Nov 08 20:33:04 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:33:02</nova:creationTime>
Nov 08 20:33:04 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:33:04 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:33:04 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:33:04 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:33:04 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:33:04 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:33:04 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:33:04 user nova-compute[74638]:       <nova:owner>
Nov 08 20:33:04 user nova-compute[74638]:         <nova:user uuid="9ab02946569c47ff9772753454afc5b3">tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member</nova:user>
Nov 08 20:33:04 user nova-compute[74638]:         <nova:project uuid="9d69c08c247c41cd842c3673cf9af390">tempest-ServerBootFromVolumeStableRescueTest-1821986023</nova:project>
Nov 08 20:33:04 user nova-compute[74638]:       </nova:owner>
Nov 08 20:33:04 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:33:04 user nova-compute[74638]:       <nova:ports>
Nov 08 20:33:04 user nova-compute[74638]:         <nova:port uuid="d6116299-160a-41e6-87ee-94c985529c3f">
Nov 08 20:33:04 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 20:33:04 user nova-compute[74638]:         </nova:port>
Nov 08 20:33:04 user nova-compute[74638]:       </nova:ports>
Nov 08 20:33:04 user nova-compute[74638]:     </nova:instance>
Nov 08 20:33:04 user nova-compute[74638]:   </metadata>
Nov 08 20:33:04 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:33:04 user nova-compute[74638]:     <system>
Nov 08 20:33:04 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:33:04 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:33:04 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:33:04 user nova-compute[74638]:       <entry name="serial">685b6be0-e0d5-4af0-bdbc-699b96f5eef8</entry>
Nov 08 20:33:04 user nova-compute[74638]:       <entry name="uuid">685b6be0-e0d5-4af0-bdbc-699b96f5eef8</entry>
Nov 08 20:33:04 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:33:04 user nova-compute[74638]:     </system>
Nov 08 20:33:04 user nova-compute[74638]:   </sysinfo>
Nov 08 20:33:04 user nova-compute[74638]:   <os>
Nov 08 20:33:04 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:33:04 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:33:04 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:33:04 user nova-compute[74638]:   </os>
Nov 08 20:33:04 user nova-compute[74638]:   <features>
Nov 08 20:33:04 user nova-compute[74638]:     <acpi/>
Nov 08 20:33:04 user nova-compute[74638]:     <apic/>
Nov 08 20:33:04 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:33:04 user nova-compute[74638]:   </features>
Nov 08 20:33:04 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:33:04 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:33:04 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:33:04 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:33:04 user nova-compute[74638]:   </clock>
Nov 08 20:33:04 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:33:04 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:33:04 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:33:04 user nova-compute[74638]:   </cpu>
Nov 08 20:33:04 user nova-compute[74638]:   <devices>
Nov 08 20:33:04 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:33:04 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:33:04 user nova-compute[74638]:       <source dev="/dev/sdd"/>
Nov 08 20:33:04 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:33:04 user nova-compute[74638]:       <serial>2acc1d1e-821b-43eb-8311-507adb61c557</serial>
Nov 08 20:33:04 user nova-compute[74638]:     </disk>
Nov 08 20:33:04 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:33:04 user nova-compute[74638]:       <mac address="fa:16:3e:43:c0:92"/>
Nov 08 20:33:04 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:33:04 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:33:04 user nova-compute[74638]:       <target dev="tapd6116299-16"/>
Nov 08 20:33:04 user nova-compute[74638]:     </interface>
Nov 08 20:33:04 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:33:04 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/console.log" append="off"/>
Nov 08 20:33:04 user nova-compute[74638]:     </serial>
Nov 08 20:33:04 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:33:04 user nova-compute[74638]:     <video>
Nov 08 20:33:04 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:33:04 user nova-compute[74638]:     </video>
Nov 08 20:33:04 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:33:04 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:33:04 user nova-compute[74638]:     </rng>
Nov 08 20:33:04 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:33:04 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:33:04 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:33:04 user nova-compute[74638]:     </memballoon>
Nov 08 20:33:04 user nova-compute[74638]:   </devices>
Nov 08 20:33:04 user nova-compute[74638]: </domain>
Nov 08 20:33:04 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-977664027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-977664027',id=37,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-rpbixtgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:31:51Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=685b6be0-e0d5-4af0-bdbc-699b96f5eef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c0:92,bridge_name='br-int',has_traffic_filtering=True,id=d6116299-160a-41e6-87ee-94c985529c3f,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6116299-16') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG os_vif [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c0:92,bridge_name='br-int',has_traffic_filtering=True,id=d6116299-160a-41e6-87ee-94c985529c3f,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6116299-16') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1da7fda-e329-5715-8be5-d45bb540d75f', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6116299-16, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6116299-16, col_values=(('qos', UUID('052671da-0c14-411c-92d2-41c8a641ef04')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6116299-16, col_values=(('external_ids', {'iface-id': 'd6116299-160a-41e6-87ee-94c985529c3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:c0:92', 'vm-uuid': '685b6be0-e0d5-4af0-bdbc-699b96f5eef8'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:04 user nova-compute[74638]: INFO os_vif [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c0:92,bridge_name='br-int',has_traffic_filtering=True,id=d6116299-160a-41e6-87ee-94c985529c3f,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6116299-16')
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:33:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No VIF found with MAC fa:16:3e:43:c0:92, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-dd8f708d-8b52-45e5-be52-1cd7e8c4469a req-6ec460c8-9fa4-4485-8b0a-23427d82e236 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dd8f708d-8b52-45e5-be52-1cd7e8c4469a req-6ec460c8-9fa4-4485-8b0a-23427d82e236 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dd8f708d-8b52-45e5-be52-1cd7e8c4469a req-6ec460c8-9fa4-4485-8b0a-23427d82e236 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dd8f708d-8b52-45e5-be52-1cd7e8c4469a req-6ec460c8-9fa4-4485-8b0a-23427d82e236 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-dd8f708d-8b52-45e5-be52-1cd7e8c4469a req-6ec460c8-9fa4-4485-8b0a-23427d82e236 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:05 user nova-compute[74638]: WARNING nova.compute.manager [req-dd8f708d-8b52-45e5-be52-1cd7e8c4469a req-6ec460c8-9fa4-4485-8b0a-23427d82e236 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state building and task_state spawning.
Nov 08 20:33:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:33:07 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance spawned successfully.
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:33:07 user nova-compute[74638]: INFO nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-2411de1e-e2c9-4c18-8646-89ba7cef0415 req-c0864e4a-21e8-467e-b78e-7ba6e9db448b service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2411de1e-e2c9-4c18-8646-89ba7cef0415 req-c0864e4a-21e8-467e-b78e-7ba6e9db448b service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2411de1e-e2c9-4c18-8646-89ba7cef0415 req-c0864e4a-21e8-467e-b78e-7ba6e9db448b service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2411de1e-e2c9-4c18-8646-89ba7cef0415 req-c0864e4a-21e8-467e-b78e-7ba6e9db448b service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-2411de1e-e2c9-4c18-8646-89ba7cef0415 req-c0864e4a-21e8-467e-b78e-7ba6e9db448b service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:07 user nova-compute[74638]: WARNING nova.compute.manager [req-2411de1e-e2c9-4c18-8646-89ba7cef0415 req-c0864e4a-21e8-467e-b78e-7ba6e9db448b service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state building and task_state spawning.
Nov 08 20:33:07 user nova-compute[74638]: INFO nova.compute.manager [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Took 77.68 seconds to build instance.
Nov 08 20:33:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-20dac8fc-542c-4bdc-802a-b51f36ff4944 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 77.782s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.950s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:07 user nova-compute[74638]: INFO nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 08 20:33:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:08 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:12 user nova-compute[74638]: INFO nova.compute.manager [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Terminating instance
Nov 08 20:33:12 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ea58297-c03f-446a-af03-91c357b229ab req-f8606d8b-0448-4667-8e86-738c178473d4 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ea58297-c03f-446a-af03-91c357b229ab req-f8606d8b-0448-4667-8e86-738c178473d4 service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ea58297-c03f-446a-af03-91c357b229ab req-f8606d8b-0448-4667-8e86-738c178473d4 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1ea58297-c03f-446a-af03-91c357b229ab req-f8606d8b-0448-4667-8e86-738c178473d4 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ea58297-c03f-446a-af03-91c357b229ab req-f8606d8b-0448-4667-8e86-738c178473d4 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-1ea58297-c03f-446a-af03-91c357b229ab req-f8606d8b-0448-4667-8e86-738c178473d4 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-unplugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Instance destroyed successfully.
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lazy-loading 'resources' on Instance uuid 862f8350-1466-4fec-b58b-2d7bd2ee8579 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2055513977',display_name='tempest-ServerRescueNegativeTestJSON-server-2055513977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2055513977',id=18,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:19:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5f133d71d494371b87181e746074d70',ramdisk_id='',reservation_id='r-0mocgist',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603324862',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603324862-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:21:35Z,user_data=None,user_id='444c578cebff4167825165a737b5bb85',uuid=862f8350-1466-4fec-b58b-2d7bd2ee8579,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converting VIF {"id": "70d09fe3-1859-4697-bfcd-315471151873", "address": "fa:16:3e:33:8e:9d", "network": {"id": "3c685948-511b-45f7-8990-2c8ca16cbad7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-884694223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5f133d71d494371b87181e746074d70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d09fe3-18", "ovs_interfaceid": "70d09fe3-1859-4697-bfcd-315471151873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:8e:9d,bridge_name='br-int',has_traffic_filtering=True,id=70d09fe3-1859-4697-bfcd-315471151873,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d09fe3-18') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG os_vif [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:8e:9d,bridge_name='br-int',has_traffic_filtering=True,id=70d09fe3-1859-4697-bfcd-315471151873,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d09fe3-18') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d09fe3-18, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=716d3917-a2f0-4e3c-b9e4-4ed97b632af2) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:13 user nova-compute[74638]: INFO os_vif [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:8e:9d,bridge_name='br-int',has_traffic_filtering=True,id=70d09fe3-1859-4697-bfcd-315471151873,network=Network(3c685948-511b-45f7-8990-2c8ca16cbad7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d09fe3-18')
Nov 08 20:33:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Deleting instance files /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579_del
Nov 08 20:33:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Deletion of /opt/stack/data/nova/instances/862f8350-1466-4fec-b58b-2d7bd2ee8579_del complete
Nov 08 20:33:13 user nova-compute[74638]: INFO nova.compute.manager [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 20:33:13 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:33:13 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:33:13 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Took 0.51 seconds to deallocate network for instance.
Nov 08 20:33:14 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9878adf-3c2d-45f7-8aae-4636b0bbf6c1 req-534d0051-b890-40d4-8862-39eb4b198730 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-deleted-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:14 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:33:14 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:33:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:14 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Deleted allocations for instance 862f8350-1466-4fec-b58b-2d7bd2ee8579
Nov 08 20:33:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a70dfca4-5ffa-4db1-b7d0-56ea0bdf29d9 tempest-ServerRescueNegativeTestJSON-1603324862 tempest-ServerRescueNegativeTestJSON-1603324862-project-member] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-94b7d6d4-332a-4017-a5b1-7489f303cc70 req-c147244e-5321-4417-8181-fc20c540a7c2 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94b7d6d4-332a-4017-a5b1-7489f303cc70 req-c147244e-5321-4417-8181-fc20c540a7c2 service nova] Acquiring lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94b7d6d4-332a-4017-a5b1-7489f303cc70 req-c147244e-5321-4417-8181-fc20c540a7c2 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-94b7d6d4-332a-4017-a5b1-7489f303cc70 req-c147244e-5321-4417-8181-fc20c540a7c2 service nova] Lock "862f8350-1466-4fec-b58b-2d7bd2ee8579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-94b7d6d4-332a-4017-a5b1-7489f303cc70 req-c147244e-5321-4417-8181-fc20c540a7c2 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] No waiting events found dispatching network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:15 user nova-compute[74638]: WARNING nova.compute.manager [req-94b7d6d4-332a-4017-a5b1-7489f303cc70 req-c147244e-5321-4417-8181-fc20c540a7c2 service nova] [instance: 862f8350-1466-4fec-b58b-2d7bd2ee8579] Received unexpected event network-vif-plugged-70d09fe3-1859-4697-bfcd-315471151873 for instance with vm_state deleted and task_state None.
Nov 08 20:33:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:33:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:33:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:33:16 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updating instance_info_cache with network_info: [{"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:33:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:33:19 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:33:19 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8224MB free_disk=25.068862915039062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 5403e126-4e0c-457f-9498-f30c802e4221 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:33:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:33:20 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:33:20 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:33:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:33:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:33:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:33:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:25 user nova-compute[74638]: INFO nova.compute.manager [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Detaching volume 444f58ed-2713-489b-919b-24d4dec89a70
Nov 08 20:33:25 user nova-compute[74638]: INFO nova.virt.block_device [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attempting to driver detach volume 444f58ed-2713-489b-919b-24d4dec89a70 from mountpoint /dev/vdb
Nov 08 20:33:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Attempting to detach device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:33:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:33:25 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:33:25 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:33:25 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:33:25 user nova-compute[74638]:   <serial>444f58ed-2713-489b-919b-24d4dec89a70</serial>
Nov 08 20:33:25 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:33:25 user nova-compute[74638]: </disk>
Nov 08 20:33:25 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:33:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully detached device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the persistent domain config.
Nov 08 20:33:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:33:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:33:25 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:33:25 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:33:25 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:33:25 user nova-compute[74638]:   <serial>444f58ed-2713-489b-919b-24d4dec89a70</serial>
Nov 08 20:33:25 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:33:25 user nova-compute[74638]: </disk>
Nov 08 20:33:25 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:33:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:33:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:26 user nova-compute[74638]: INFO nova.compute.manager [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Terminating instance
Nov 08 20:33:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:33:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-bcc3585f-24f1-4df6-af11-7b44cbaf5771 req-77a6ae5f-3ea4-468b-aca7-7f356945fa21 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-unplugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bcc3585f-24f1-4df6-af11-7b44cbaf5771 req-77a6ae5f-3ea4-468b-aca7-7f356945fa21 service nova] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bcc3585f-24f1-4df6-af11-7b44cbaf5771 req-77a6ae5f-3ea4-468b-aca7-7f356945fa21 service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bcc3585f-24f1-4df6-af11-7b44cbaf5771 req-77a6ae5f-3ea4-468b-aca7-7f356945fa21 service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-bcc3585f-24f1-4df6-af11-7b44cbaf5771 req-77a6ae5f-3ea4-468b-aca7-7f356945fa21 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] No waiting events found dispatching network-vif-unplugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-bcc3585f-24f1-4df6-af11-7b44cbaf5771 req-77a6ae5f-3ea4-468b-aca7-7f356945fa21 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-unplugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Instance destroyed successfully.
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.objects.instance [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lazy-loading 'resources' on Instance uuid c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2144409548',display_name='tempest-VolumesActionsTest-instance-2144409548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2144409548',id=36,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:31:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d45047adc05a46db9f719f9d0579c276',ramdisk_id='',reservation_id='r-1el5lc7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1038485660',owner_user_name='tempest-VolumesActionsTest-1038485660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:31:43Z,user_data=None,user_id='c3b8411366b341f5936fffed75e319e7',uuid=c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converting VIF {"id": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "address": "fa:16:3e:60:0b:df", "network": {"id": "1107953f-272f-4f5f-b6ef-d283ef0488dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937987777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d45047adc05a46db9f719f9d0579c276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93454977-ef", "ovs_interfaceid": "93454977-ef9b-4fb2-b4dd-78a1a5890ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=93454977-ef9b-4fb2-b4dd-78a1a5890ec9,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93454977-ef') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG os_vif [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=93454977-ef9b-4fb2-b4dd-78a1a5890ec9,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93454977-ef') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93454977-ef, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f230ce9a-1ce5-43cf-a7bf-dbdb20e3ad54) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:27 user nova-compute[74638]: INFO os_vif [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:0b:df,bridge_name='br-int',has_traffic_filtering=True,id=93454977-ef9b-4fb2-b4dd-78a1a5890ec9,network=Network(1107953f-272f-4f5f-b6ef-d283ef0488dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93454977-ef')
Nov 08 20:33:27 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Deleting instance files /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d_del
Nov 08 20:33:27 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Deletion of /opt/stack/data/nova/instances/c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d_del complete
Nov 08 20:33:27 user nova-compute[74638]: INFO nova.compute.manager [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 08 20:33:27 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:33:27 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:33:28 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Took 0.59 seconds to deallocate network for instance.
Nov 08 20:33:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-84b51edf-d109-445e-828c-abef1ca25eb4 req-2493cf12-9d58-47de-8e84-82e3fed74303 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-deleted-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:28 user nova-compute[74638]: INFO nova.compute.manager [req-84b51edf-d109-445e-828c-abef1ca25eb4 req-2493cf12-9d58-47de-8e84-82e3fed74303 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Neutron deleted interface 93454977-ef9b-4fb2-b4dd-78a1a5890ec9; detaching it from the instance and deleting it from the info cache
Nov 08 20:33:28 user nova-compute[74638]: DEBUG nova.network.neutron [req-84b51edf-d109-445e-828c-abef1ca25eb4 req-2493cf12-9d58-47de-8e84-82e3fed74303 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-84b51edf-d109-445e-828c-abef1ca25eb4 req-2493cf12-9d58-47de-8e84-82e3fed74303 service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Detach interface failed, port_id=93454977-ef9b-4fb2-b4dd-78a1a5890ec9, reason: Instance c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:33:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:28 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Deleted allocations for instance c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-306f5574-ff81-4caf-b83d-1451ece951a4 tempest-VolumesActionsTest-1038485660 tempest-VolumesActionsTest-1038485660-project-member] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.114s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] No waiting events found dispatching network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:29 user nova-compute[74638]: WARNING nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received unexpected event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 for instance with vm_state deleted and task_state None.
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] No waiting events found dispatching network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:29 user nova-compute[74638]: WARNING nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received unexpected event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 for instance with vm_state deleted and task_state None.
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] No waiting events found dispatching network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:29 user nova-compute[74638]: WARNING nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received unexpected event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 for instance with vm_state deleted and task_state None.
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-unplugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] No waiting events found dispatching network-vif-unplugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:29 user nova-compute[74638]: WARNING nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received unexpected event network-vif-unplugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 for instance with vm_state deleted and task_state None.
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Acquiring lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] Lock "c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] No waiting events found dispatching network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:29 user nova-compute[74638]: WARNING nova.compute.manager [req-3a767b92-bc91-473f-a03d-9d108f7cbafc req-fd1ef767-888c-4a3a-8a89-8a9a2acf3e4a service nova] [instance: c9acb7c7-8f58-4e24-9993-2d50c0fe7a1d] Received unexpected event network-vif-plugged-93454977-ef9b-4fb2-b4dd-78a1a5890ec9 for instance with vm_state deleted and task_state None.
Nov 08 20:33:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:45 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b409323-6dcf-4395-92ec-1d79b27c515b is timed out.
Nov 08 20:33:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully detached device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the live domain config.
Nov 08 20:33:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lQTbifjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:33:45 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:33:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[283c65cb-a334-4e0e-bffa-24f12a79ce63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:33:45 user nova-compute[74638]: No targets found.
Nov 08 20:33:45 user nova-compute[74638]: iSNS:
Nov 08 20:33:45 user nova-compute[74638]: No targets found.
Nov 08 20:33:45 user nova-compute[74638]: STATIC:
Nov 08 20:33:45 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557
Nov 08 20:33:45 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:33:45 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:33:45 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:33:45 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:33:45 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:33:45 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70
Nov 08 20:33:45 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:33:45 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:33:45 user nova-compute[74638]: FIRMWARE:
Nov 08 20:33:45 user nova-compute[74638]: No targets found.
Nov 08 20:33:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:33:45 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:33:45 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:33:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[42863938-d37f-48c0-8c94-108da3ea37da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f71172b-8dfb-40a5-8c66-b6c44822219b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:33:46 user nova-compute[74638]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)
Nov 08 20:33:46 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:33:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:33:46 user nova-compute[74638]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 (non-flash)
Nov 08 20:33:46 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:33:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c35cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc69657-547e-4e04-97e4-cdcb686b72bb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca1e828-7d59-4f5d-96c6-979ea50ef62f]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c146d6-4752-4fec-9e47-67de1ed49b3e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a8484-d6eb-4022-b62c-40a4fee75cce]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7705b542-d252-4c34-94c7-24abfbc38736]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f53cda3-a8d0-4667-9a13-5501ab9c2eb5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70, portal: 172.16.0.220,3260]
Nov 08 20:33:46 user nova-compute[74638]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70, portal: 172.16.0.220,3260] successful.
Nov 08 20:33:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:444f58ed-2713-489b-919b-24d4dec89a70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[04733990-5b2f-453c-a83d-7f1874b04e7d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== disconnect_volume: return (332ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:33:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:33:47 user nova-compute[74638]: DEBUG nova.objects.instance [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:33:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-0c57b41d-7c08-43b1-83fd-23d3003d9085 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.853s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:49 user nova-compute[74638]: INFO nova.compute.manager [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Terminating instance
Nov 08 20:33:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2e77f389-6c02-436b-b645-0780c584cf25 req-f3dc47ca-08aa-4c57-a4ea-779737cfeac9 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-unplugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2e77f389-6c02-436b-b645-0780c584cf25 req-f3dc47ca-08aa-4c57-a4ea-779737cfeac9 service nova] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2e77f389-6c02-436b-b645-0780c584cf25 req-f3dc47ca-08aa-4c57-a4ea-779737cfeac9 service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2e77f389-6c02-436b-b645-0780c584cf25 req-f3dc47ca-08aa-4c57-a4ea-779737cfeac9 service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2e77f389-6c02-436b-b645-0780c584cf25 req-f3dc47ca-08aa-4c57-a4ea-779737cfeac9 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] No waiting events found dispatching network-vif-unplugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-2e77f389-6c02-436b-b645-0780c584cf25 req-f3dc47ca-08aa-4c57-a4ea-779737cfeac9 service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-unplugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Instance destroyed successfully.
Nov 08 20:33:50 user nova-compute[74638]: DEBUG nova.objects.instance [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lazy-loading 'resources' on Instance uuid 5403e126-4e0c-457f-9498-f30c802e4221 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1699605769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1699605769',id=32,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWaFwkY2NS87T6PgIiYutByvkZteVxZKIwNP2LzlkZOYzVKOH4Nl2XHk3cvHIPUTTrjpWOTVdOD3OK+OU1RlXTEly6HwPaCwcICBnz9In5k5jEqZRqdc4qSg4uHjrR3A==',key_name='tempest-keypair-2077397320',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:32:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad76637f4c184691893fc1c41cb6d08c',ramdisk_id='',reservation_id='r-m0ncmvqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1349495348',owner_user_name='tempest-AttachVolumeShelveTestJSON-1349495348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5d2a2e56dfc441ea12bfe9a89527a2d',uuid=5403e126-4e0c-457f-9498-f30c802e4221,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converting VIF {"id": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "address": "fa:16:3e:a2:66:37", "network": {"id": "41b77b0e-6cca-4468-9700-9f022af764e8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-316599055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad76637f4c184691893fc1c41cb6d08c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb11383c-4b", "ovs_interfaceid": "eb11383c-4b16-4824-bfff-4eedb2dcda08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG os_vif [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb11383c-4b, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d35d70c-ab0c-4326-9f0f-ce94f9cf508d) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:50 user nova-compute[74638]: INFO os_vif [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:66:37,bridge_name='br-int',has_traffic_filtering=True,id=eb11383c-4b16-4824-bfff-4eedb2dcda08,network=Network(41b77b0e-6cca-4468-9700-9f022af764e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb11383c-4b')
Nov 08 20:33:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Deleting instance files /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221_del
Nov 08 20:33:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Deletion of /opt/stack/data/nova/instances/5403e126-4e0c-457f-9498-f30c802e4221_del complete
Nov 08 20:33:50 user nova-compute[74638]: INFO nova.compute.manager [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 20:33:50 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:33:50 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:33:50 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Took 0.71 seconds to deallocate network for instance.
Nov 08 20:33:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:51 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Deleted allocations for instance 5403e126-4e0c-457f-9498-f30c802e4221
Nov 08 20:33:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b8246650-8f32-493d-9389-783c2cfe7734 tempest-AttachVolumeShelveTestJSON-1349495348 tempest-AttachVolumeShelveTestJSON-1349495348-project-member] Lock "5403e126-4e0c-457f-9498-f30c802e4221" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.047s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-1dd73370-23bb-4079-b77c-aa0cede3e5ea req-26bb6b07-62bd-45ff-aa0c-4084c6b1018b service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1dd73370-23bb-4079-b77c-aa0cede3e5ea req-26bb6b07-62bd-45ff-aa0c-4084c6b1018b service nova] Acquiring lock "5403e126-4e0c-457f-9498-f30c802e4221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1dd73370-23bb-4079-b77c-aa0cede3e5ea req-26bb6b07-62bd-45ff-aa0c-4084c6b1018b service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1dd73370-23bb-4079-b77c-aa0cede3e5ea req-26bb6b07-62bd-45ff-aa0c-4084c6b1018b service nova] Lock "5403e126-4e0c-457f-9498-f30c802e4221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:33:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-1dd73370-23bb-4079-b77c-aa0cede3e5ea req-26bb6b07-62bd-45ff-aa0c-4084c6b1018b service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] No waiting events found dispatching network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:33:51 user nova-compute[74638]: WARNING nova.compute.manager [req-1dd73370-23bb-4079-b77c-aa0cede3e5ea req-26bb6b07-62bd-45ff-aa0c-4084c6b1018b service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received unexpected event network-vif-plugged-eb11383c-4b16-4824-bfff-4eedb2dcda08 for instance with vm_state deleted and task_state None.
Nov 08 20:33:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-1dd73370-23bb-4079-b77c-aa0cede3e5ea req-26bb6b07-62bd-45ff-aa0c-4084c6b1018b service nova] [instance: 5403e126-4e0c-457f-9498-f30c802e4221] Received event network-vif-deleted-eb11383c-4b16-4824-bfff-4eedb2dcda08 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:33:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:33:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:34:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:34:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:34:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:34:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:12 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:12 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:34:13 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:15 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:19 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:34:19 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8477MB free_disk=25.105915069580078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:34:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:34:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:34:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:34:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:34:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating instance_info_cache with network_info: [{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:34:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:34:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:34:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:22 user nova-compute[74638]: DEBUG nova.objects.instance [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:23 user nova-compute[74638]: INFO nova.compute.manager [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attaching volume c01a8fac-5631-4a5b-a34d-55d8d4eb715c to /dev/vdb
Nov 08 20:34:23 user nova-compute[74638]: DEBUG os_brick.utils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9978f097-8b30-4b40-b80c-ef1ae51486ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd6dcf9-d254-456f-b19d-66f16e7489f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[879905a5-b6f5-4587-8eb0-981bf49b2467]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41b3bf-8fbf-45ee-9112-8aec1532300c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:34:23 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bb152b-3403-4cb3-a257-638a891b1b37]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG os_brick.utils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating existing volume attachment record: 99ba241d-fee8-4c97-981a-9ecb12afd61c {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:34:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:27 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:34:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:27 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:34:27 user nova-compute[74638]: INFO nova.compute.claims [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Claim successful on node user
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:34:28 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.policy [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '055e6d6be11a4365af65a6f5090eee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c12f4f25aa40889f55cc73ac02a098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:34:28 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Creating image(s)
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "/opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "/opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "985d7b376f61d5d5973f9c78f51e2041ae70d183" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "985d7b376f61d5d5973f9c78f51e2041ae70d183" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.virt.images [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ae1b1a07-db61-49ca-b03a-0c7257589e84 was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:34:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183.part /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Successfully created port: 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183.part /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183.converted" returned: 0 in 0.357s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "985d7b376f61d5d5973f9c78f51e2041ae70d183" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.163s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "985d7b376f61d5d5973f9c78f51e2041ae70d183" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "985d7b376f61d5d5973f9c78f51e2041ae70d183" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Successfully updated port: 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquired lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-8d6d52e6-d772-4298-9ea9-8c2a239e7439 req-58e403f8-4a12-4e14-8d77-a7da3453c77d service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-8d6d52e6-d772-4298-9ea9-8c2a239e7439 req-58e403f8-4a12-4e14-8d77-a7da3453c77d service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing instance network info cache due to event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8d6d52e6-d772-4298-9ea9-8c2a239e7439 req-58e403f8-4a12-4e14-8d77-a7da3453c77d service nova] Acquiring lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 --force-share --output=json" returned: 0 in 0.199s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183,backing_fmt=raw /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183,backing_fmt=raw /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk 1073741824" returned: 0 in 0.058s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "985d7b376f61d5d5973f9c78f51e2041ae70d183" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Releasing lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Instance network_info: |[{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8d6d52e6-d772-4298-9ea9-8c2a239e7439 req-58e403f8-4a12-4e14-8d77-a7da3453c77d service nova] Acquired lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-8d6d52e6-d772-4298-9ea9-8c2a239e7439 req-58e403f8-4a12-4e14-8d77-a7da3453c77d service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Cannot resize image /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Ensure instance console log exists: /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Start _get_guest_xml network_info=[{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:34:25Z,direct_url=<?>,disk_format='qcow2',id=ae1b1a07-db61-49ca-b03a-0c7257589e84,min_disk=0,min_ram=0,name='tempest-scenario-img--1370453540',owner='45c12f4f25aa40889f55cc73ac02a098',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:34:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'ae1b1a07-db61-49ca-b03a-0c7257589e84'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:34:30 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:34:30 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:34:25Z,direct_url=<?>,disk_format='qcow2',id=ae1b1a07-db61-49ca-b03a-0c7257589e84,min_disk=0,min_ram=0,name='tempest-scenario-img--1370453540',owner='45c12f4f25aa40889f55cc73ac02a098',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:34:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1325662292',display_name='tempest-TestMinimumBasicScenario-server-1325662292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1325662292',id=38,image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCPi1E0igEFZIdJhZePk4DFeVJRb0sGuZNECAaBx8cK2GZaERHs7lvKuVpUC4dqiBhtTTuoqxTWClMijGvMvsL9sYx84lTEJSNMJFUnoSzDfmc6zIJbGw39SqU9mhTrQ==',key_name='tempest-TestMinimumBasicScenario-551223592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-btomml66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:34:28Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=d6a4f12a-a033-461a-82c0-157b2be2dcd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.objects.instance [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'pci_devices' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:34:30 user nova-compute[74638]:   <uuid>d6a4f12a-a033-461a-82c0-157b2be2dcd8</uuid>
Nov 08 20:34:30 user nova-compute[74638]:   <name>instance-00000026</name>
Nov 08 20:34:30 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:34:30 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:34:30 user nova-compute[74638]:   <metadata>
Nov 08 20:34:30 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:34:30 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:34:30 user nova-compute[74638]:       <nova:name>tempest-TestMinimumBasicScenario-server-1325662292</nova:name>
Nov 08 20:34:30 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:34:30</nova:creationTime>
Nov 08 20:34:30 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:34:30 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:34:30 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:34:30 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:34:30 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:34:30 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:34:30 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:34:30 user nova-compute[74638]:       <nova:owner>
Nov 08 20:34:30 user nova-compute[74638]:         <nova:user uuid="055e6d6be11a4365af65a6f5090eee90">tempest-TestMinimumBasicScenario-1423913344-project-member</nova:user>
Nov 08 20:34:30 user nova-compute[74638]:         <nova:project uuid="45c12f4f25aa40889f55cc73ac02a098">tempest-TestMinimumBasicScenario-1423913344</nova:project>
Nov 08 20:34:30 user nova-compute[74638]:       </nova:owner>
Nov 08 20:34:30 user nova-compute[74638]:       <nova:root type="image" uuid="ae1b1a07-db61-49ca-b03a-0c7257589e84"/>
Nov 08 20:34:30 user nova-compute[74638]:       <nova:ports>
Nov 08 20:34:30 user nova-compute[74638]:         <nova:port uuid="6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a">
Nov 08 20:34:30 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 20:34:30 user nova-compute[74638]:         </nova:port>
Nov 08 20:34:30 user nova-compute[74638]:       </nova:ports>
Nov 08 20:34:30 user nova-compute[74638]:     </nova:instance>
Nov 08 20:34:30 user nova-compute[74638]:   </metadata>
Nov 08 20:34:30 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:34:30 user nova-compute[74638]:     <system>
Nov 08 20:34:30 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:34:30 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:34:30 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:34:30 user nova-compute[74638]:       <entry name="serial">d6a4f12a-a033-461a-82c0-157b2be2dcd8</entry>
Nov 08 20:34:30 user nova-compute[74638]:       <entry name="uuid">d6a4f12a-a033-461a-82c0-157b2be2dcd8</entry>
Nov 08 20:34:30 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:34:30 user nova-compute[74638]:     </system>
Nov 08 20:34:30 user nova-compute[74638]:   </sysinfo>
Nov 08 20:34:30 user nova-compute[74638]:   <os>
Nov 08 20:34:30 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:34:30 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:34:30 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:34:30 user nova-compute[74638]:   </os>
Nov 08 20:34:30 user nova-compute[74638]:   <features>
Nov 08 20:34:30 user nova-compute[74638]:     <acpi/>
Nov 08 20:34:30 user nova-compute[74638]:     <apic/>
Nov 08 20:34:30 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:34:30 user nova-compute[74638]:   </features>
Nov 08 20:34:30 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:34:30 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:34:30 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:34:30 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:34:30 user nova-compute[74638]:   </clock>
Nov 08 20:34:30 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:34:30 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:34:30 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:34:30 user nova-compute[74638]:   </cpu>
Nov 08 20:34:30 user nova-compute[74638]:   <devices>
Nov 08 20:34:30 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:34:30 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:34:30 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk"/>
Nov 08 20:34:30 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:34:30 user nova-compute[74638]:     </disk>
Nov 08 20:34:30 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:34:30 user nova-compute[74638]:       <mac address="fa:16:3e:42:24:ed"/>
Nov 08 20:34:30 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:34:30 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:34:30 user nova-compute[74638]:       <target dev="tap6f99d813-1d"/>
Nov 08 20:34:30 user nova-compute[74638]:     </interface>
Nov 08 20:34:30 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:34:30 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/console.log" append="off"/>
Nov 08 20:34:30 user nova-compute[74638]:     </serial>
Nov 08 20:34:30 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:34:30 user nova-compute[74638]:     <video>
Nov 08 20:34:30 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:34:30 user nova-compute[74638]:     </video>
Nov 08 20:34:30 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:34:30 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:34:30 user nova-compute[74638]:     </rng>
Nov 08 20:34:30 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:34:30 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:34:30 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:34:30 user nova-compute[74638]:     </memballoon>
Nov 08 20:34:30 user nova-compute[74638]:   </devices>
Nov 08 20:34:30 user nova-compute[74638]: </domain>
Nov 08 20:34:30 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1325662292',display_name='tempest-TestMinimumBasicScenario-server-1325662292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1325662292',id=38,image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCPi1E0igEFZIdJhZePk4DFeVJRb0sGuZNECAaBx8cK2GZaERHs7lvKuVpUC4dqiBhtTTuoqxTWClMijGvMvsL9sYx84lTEJSNMJFUnoSzDfmc6zIJbGw39SqU9mhTrQ==',key_name='tempest-TestMinimumBasicScenario-551223592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-btomml66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:34:28Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=d6a4f12a-a033-461a-82c0-157b2be2dcd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG os_vif [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9db02c8b-f160-5c40-9f63-0727eeceefdd', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f99d813-1d, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f99d813-1d, col_values=(('qos', UUID('9426e56c-fd73-4450-a2df-907ddd9c0681')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f99d813-1d, col_values=(('external_ids', {'iface-id': '6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:24:ed', 'vm-uuid': 'd6a4f12a-a033-461a-82c0-157b2be2dcd8'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:30 user nova-compute[74638]: INFO os_vif [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d')
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No VIF found with MAC fa:16:3e:42:24:ed, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-8d6d52e6-d772-4298-9ea9-8c2a239e7439 req-58e403f8-4a12-4e14-8d77-a7da3453c77d service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updated VIF entry in instance network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-8d6d52e6-d772-4298-9ea9-8c2a239e7439 req-58e403f8-4a12-4e14-8d77-a7da3453c77d service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:34:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8d6d52e6-d772-4298-9ea9-8c2a239e7439 req-58e403f8-4a12-4e14-8d77-a7da3453c77d service nova] Releasing lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:34:31 user nova-compute[74638]: INFO nova.compute.manager [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Rescuing
Nov 08 20:34:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:34:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquired lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:34:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:34:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Updating instance_info_cache with network_info: [{"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Releasing lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-01a5b0be-c52d-4142-9364-342129f85338 req-c9a7b4b0-0dca-4294-b91e-54d3ce71a778 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-01a5b0be-c52d-4142-9364-342129f85338 req-c9a7b4b0-0dca-4294-b91e-54d3ce71a778 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-01a5b0be-c52d-4142-9364-342129f85338 req-c9a7b4b0-0dca-4294-b91e-54d3ce71a778 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-01a5b0be-c52d-4142-9364-342129f85338 req-c9a7b4b0-0dca-4294-b91e-54d3ce71a778 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-01a5b0be-c52d-4142-9364-342129f85338 req-c9a7b4b0-0dca-4294-b91e-54d3ce71a778 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:32 user nova-compute[74638]: WARNING nova.compute.manager [req-01a5b0be-c52d-4142-9364-342129f85338 req-c9a7b4b0-0dca-4294-b91e-54d3ce71a778 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state rescuing.
Nov 08 20:34:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-84c9a317-2b48-4755-bcd4-c304c8f16dfa req-af5df613-2cf0-4e7d-83a5-29368ab256f8 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-84c9a317-2b48-4755-bcd4-c304c8f16dfa req-af5df613-2cf0-4e7d-83a5-29368ab256f8 service nova] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-84c9a317-2b48-4755-bcd4-c304c8f16dfa req-af5df613-2cf0-4e7d-83a5-29368ab256f8 service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-84c9a317-2b48-4755-bcd4-c304c8f16dfa req-af5df613-2cf0-4e7d-83a5-29368ab256f8 service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-84c9a317-2b48-4755-bcd4-c304c8f16dfa req-af5df613-2cf0-4e7d-83a5-29368ab256f8 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] No waiting events found dispatching network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:32 user nova-compute[74638]: WARNING nova.compute.manager [req-84c9a317-2b48-4755-bcd4-c304c8f16dfa req-af5df613-2cf0-4e7d-83a5-29368ab256f8 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received unexpected event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a for instance with vm_state building and task_state spawning.
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance destroyed successfully.
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:32 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Attempting a stable device rescue
Nov 08 20:34:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74638) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance directory exists: not creating {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 20:34:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Creating image(s)
Nov 08 20:34:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "/opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "/opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "/opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'trusted_certs' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "aa8f926f0f10945ac0d39cc8624142a698493d6a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "aa8f926f0f10945ac0d39cc8624142a698493d6a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc01906c-51aa-4290-b670-318c81479809 req-2a3e88f2-40cb-4619-b300-0cbc19ae6fdf service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc01906c-51aa-4290-b670-318c81479809 req-2a3e88f2-40cb-4619-b300-0cbc19ae6fdf service nova] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc01906c-51aa-4290-b670-318c81479809 req-2a3e88f2-40cb-4619-b300-0cbc19ae6fdf service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc01906c-51aa-4290-b670-318c81479809 req-2a3e88f2-40cb-4619-b300-0cbc19ae6fdf service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc01906c-51aa-4290-b670-318c81479809 req-2a3e88f2-40cb-4619-b300-0cbc19ae6fdf service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] No waiting events found dispatching network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:34 user nova-compute[74638]: WARNING nova.compute.manager [req-bc01906c-51aa-4290-b670-318c81479809 req-2a3e88f2-40cb-4619-b300-0cbc19ae6fdf service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received unexpected event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a for instance with vm_state building and task_state spawning.
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:34 user nova-compute[74638]: WARNING nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state rescuing.
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:34 user nova-compute[74638]: WARNING nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state rescuing.
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:34 user nova-compute[74638]: WARNING nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state rescuing.
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:34 user nova-compute[74638]: WARNING nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state rescuing.
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:34 user nova-compute[74638]: WARNING nova.compute.manager [req-bc1e3741-7c55-412c-8e3e-f476fb4246a3 req-63add2c3-e72d-4a58-aeb5-198bb7ef8d07 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state rescuing.
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.virt.images [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] 5baf711a-5c8d-4e2f-b4a0-f566334f727a was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a.part /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a.part /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a.converted" returned: 0 in 0.254s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:34:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Instance spawned successfully.
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "aa8f926f0f10945ac0d39cc8624142a698493d6a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.089s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "aa8f926f0f10945ac0d39cc8624142a698493d6a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "aa8f926f0f10945ac0d39cc8624142a698493d6a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: INFO nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a,backing_fmt=raw /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: INFO nova.compute.manager [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Took 7.77 seconds to build instance.
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a,backing_fmt=raw /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue" returned: 0 in 0.060s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "aa8f926f0f10945ac0d39cc8624142a698493d6a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'migration_context' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<685b6be0-e0d5-4af0-bdbc-699b96f5eef8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Start _get_guest_xml network_info=[{"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "vif_mac": "fa:16:3e:43:c0:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5baf711a-5c8d-4e2f-b4a0-f566334f727a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '1f294173-e7ac-4348-90bc-c4c443e9e384', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIxiCOTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '685b6be0-e0d5-4af0-bdbc-699b96f5eef8', 'attached_at': '', 'detached_at': '', 'volume_id': '2acc1d1e-821b-43eb-8311-507adb61c557', 'serial': '2acc1d1e-821b-43eb-8311-507adb61c557'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'resources' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eacdc87f-83e8-4a25-8875-fe96cccc2410 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.890s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<685b6be0-e0d5-4af0-bdbc-699b96f5eef8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'numa_topology' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<685b6be0-e0d5-4af0-bdbc-699b96f5eef8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:34:35 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:34:35 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'vcpu_model' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<685b6be0-e0d5-4af0-bdbc-699b96f5eef8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIxiCOTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:34:35 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:34:35 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:34:35 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eaed88-228d-4bc6-9a1f-faa395553a46]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mIxiCOTn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 20:34:35 user nova-compute[74638]: node.name = iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557
Nov 08 20:34:35 user nova-compute[74638]: node.tpgt = -1
Nov 08 20:34:35 user nova-compute[74638]: node.startup = automatic
Nov 08 20:34:35 user nova-compute[74638]: node.leading_login = No
Nov 08 20:34:35 user nova-compute[74638]: iface.iscsi_ifacename = default
Nov 08 20:34:35 user nova-compute[74638]: iface.net_ifacename = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.ipaddress = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.prefix_len = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.hwaddress = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.transport_name = tcp
Nov 08 20:34:35 user nova-compute[74638]: iface.initiatorname = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.state = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.vlan_id = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.vlan_priority = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.vlan_state = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.iface_num = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.mtu = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.port = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.bootproto = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.subnet_mask = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.gateway = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.dhcp_alt_client_id = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.dhcp_dns = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.dhcp_learn_iqn = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.dhcp_vendor_id_state = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.dhcp_vendor_id = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.dhcp_slp_da = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.fragmentation = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.gratuitous_arp = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.incoming_forwarding = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.tos_state = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.tos = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.ttl = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.delayed_ack = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.tcp_nagle = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.tcp_wsf_state = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.tcp_wsf = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.tcp_timer_scale = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.tcp_timestamp = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.redirect = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.def_task_mgmt_timeout = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.header_digest = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.data_digest = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.immediate_data = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.initial_r2t = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.data_seq_inorder = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.data_pdu_inorder = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.erl = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.max_receive_data_len = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.first_burst_len = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.max_outstanding_r2t = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.max_burst_len = 0
Nov 08 20:34:35 user nova-compute[74638]: iface.chap_auth = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.bidi_chap = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.strict_login_compliance = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.discovery_auth = <empty>
Nov 08 20:34:35 user nova-compute[74638]: iface.discovery_logout = <empty>
Nov 08 20:34:35 user nova-compute[74638]: node.discovery_address = <empty>
Nov 08 20:34:35 user nova-compute[74638]: node.discovery_port = 0
Nov 08 20:34:35 user nova-compute[74638]: node.discovery_type = static
Nov 08 20:34:35 user nova-compute[74638]: node.session.initial_cmdsn = 0
Nov 08 20:34:35 user nova-compute[74638]: node.session.initial_login_retry_max = 8
Nov 08 20:34:35 user nova-compute[74638]: node.session.xmit_thread_priority = -20
Nov 08 20:34:35 user nova-compute[74638]: node.session.cmds_max = 128
Nov 08 20:34:35 user nova-compute[74638]: node.session.queue_depth = 32
Nov 08 20:34:35 user nova-compute[74638]: node.session.nr_sessions = 1
Nov 08 20:34:35 user nova-compute[74638]: node.session.auth.authmethod = CHAP
Nov 08 20:34:35 user nova-compute[74638]: node.session.auth.username = mIxiCOTn
Nov 08 20:34:35 user nova-compute[74638]: node.session.auth.password = ***
Nov 08 20:34:35 user nova-compute[74638]: node.session.auth.username_in = <empty>
Nov 08 20:34:35 user nova-compute[74638]: node.session.auth.password_in = <empty>
Nov 08 20:34:35 user nova-compute[74638]: node.session.auth.chap_algs = MD5
Nov 08 20:34:35 user nova-compute[74638]: node.session.timeo.replacement_timeout = 120
Nov 08 20:34:35 user nova-compute[74638]: node.session.err_timeo.abort_timeout = 15
Nov 08 20:34:35 user nova-compute[74638]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 20:34:35 user nova-compute[74638]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 20:34:35 user nova-compute[74638]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.FastAbort = Yes
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.InitialR2T = No
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.ImmediateData = Yes
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.MaxConnections = 1
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 20:34:35 user nova-compute[74638]: node.session.iscsi.ERL = 0
Nov 08 20:34:35 user nova-compute[74638]: node.session.scan = manual
Nov 08 20:34:35 user nova-compute[74638]: node.session.reopen_max = 0
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].address = 172.16.0.220
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].port = 3260
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].startup = manual
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].tcp.window_size = 524288
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].tcp.type_of_service = 0
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].timeo.logout_timeout = 15
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].timeo.login_timeout = 15
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].timeo.auth_timeout = 45
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].iscsi.DataDigest = None
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].iscsi.IFMarker = No
Nov 08 20:34:35 user nova-compute[74638]: node.conn[0].iscsi.OFMarker = No
Nov 08 20:34:35 user nova-compute[74638]: # END RECORD
Nov 08 20:34:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f82d8f8-a834-4752-959d-92456d34705f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e050c2a-0d9a-4918-b1b5-28270c45cb42]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIxiCOTn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIxiCOTn" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb67921b-77cd-4c35-b6e7-e54a7876ab61]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mIxiCOTn'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec088097-56d4-4674-9397-5c3d0c761283]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f777b-46bb-40ea-b5cc-57cbe08ffd15]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:34:35 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:34:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:34:35 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:34:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] HCTL ('35', '0', '0', 0) found on session 37 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a7a605-f1e9-43ab-8ebc-09d78eca87f5]: (4, ('0 0 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Searching for a device in session 37 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIxiCOTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23165363737353266', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165363737353266', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-977664027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-977664027',id=37,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:33:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-rpbixtgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:33:08Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=685b6be0-e0d5-4af0-bdbc-699b96f5eef8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "vif_mac": "fa:16:3e:43:c0:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "vif_mac": "fa:16:3e:43:c0:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:c0:92,bridge_name='br-int',has_traffic_filtering=True,id=d6116299-160a-41e6-87ee-94c985529c3f,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6116299-16') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'pci_devices' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.objects.base [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Object Instance<685b6be0-e0d5-4af0-bdbc-699b96f5eef8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:34:35 user nova-compute[74638]:   <uuid>685b6be0-e0d5-4af0-bdbc-699b96f5eef8</uuid>
Nov 08 20:34:35 user nova-compute[74638]:   <name>instance-00000025</name>
Nov 08 20:34:35 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:34:35 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:34:35 user nova-compute[74638]:   <metadata>
Nov 08 20:34:35 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:34:35 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:34:35 user nova-compute[74638]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-977664027</nova:name>
Nov 08 20:34:35 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:34:35</nova:creationTime>
Nov 08 20:34:35 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:34:35 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:34:35 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:34:35 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:34:35 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:34:35 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:34:35 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:34:35 user nova-compute[74638]:       <nova:owner>
Nov 08 20:34:35 user nova-compute[74638]:         <nova:user uuid="9ab02946569c47ff9772753454afc5b3">tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member</nova:user>
Nov 08 20:34:35 user nova-compute[74638]:         <nova:project uuid="9d69c08c247c41cd842c3673cf9af390">tempest-ServerBootFromVolumeStableRescueTest-1821986023</nova:project>
Nov 08 20:34:35 user nova-compute[74638]:       </nova:owner>
Nov 08 20:34:35 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:34:35 user nova-compute[74638]:       <nova:ports>
Nov 08 20:34:35 user nova-compute[74638]:         <nova:port uuid="d6116299-160a-41e6-87ee-94c985529c3f">
Nov 08 20:34:35 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 20:34:35 user nova-compute[74638]:         </nova:port>
Nov 08 20:34:35 user nova-compute[74638]:       </nova:ports>
Nov 08 20:34:35 user nova-compute[74638]:     </nova:instance>
Nov 08 20:34:35 user nova-compute[74638]:   </metadata>
Nov 08 20:34:35 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:34:35 user nova-compute[74638]:     <system>
Nov 08 20:34:35 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:34:35 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:34:35 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:34:35 user nova-compute[74638]:       <entry name="serial">685b6be0-e0d5-4af0-bdbc-699b96f5eef8</entry>
Nov 08 20:34:35 user nova-compute[74638]:       <entry name="uuid">685b6be0-e0d5-4af0-bdbc-699b96f5eef8</entry>
Nov 08 20:34:35 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:34:35 user nova-compute[74638]:     </system>
Nov 08 20:34:35 user nova-compute[74638]:   </sysinfo>
Nov 08 20:34:35 user nova-compute[74638]:   <os>
Nov 08 20:34:35 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:34:35 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:34:35 user nova-compute[74638]:   </os>
Nov 08 20:34:35 user nova-compute[74638]:   <features>
Nov 08 20:34:35 user nova-compute[74638]:     <acpi/>
Nov 08 20:34:35 user nova-compute[74638]:     <apic/>
Nov 08 20:34:35 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:34:35 user nova-compute[74638]:   </features>
Nov 08 20:34:35 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:34:35 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:34:35 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:34:35 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:34:35 user nova-compute[74638]:   </clock>
Nov 08 20:34:35 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:34:35 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:34:35 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:34:35 user nova-compute[74638]:   </cpu>
Nov 08 20:34:35 user nova-compute[74638]:   <devices>
Nov 08 20:34:35 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:34:35 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:34:35 user nova-compute[74638]:       <source dev="/dev/sdd"/>
Nov 08 20:34:35 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:34:35 user nova-compute[74638]:       <serial>2acc1d1e-821b-43eb-8311-507adb61c557</serial>
Nov 08 20:34:35 user nova-compute[74638]:     </disk>
Nov 08 20:34:35 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:34:35 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:34:35 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue"/>
Nov 08 20:34:35 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:34:35 user nova-compute[74638]:       <boot order="1"/>
Nov 08 20:34:35 user nova-compute[74638]:     </disk>
Nov 08 20:34:35 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:34:35 user nova-compute[74638]:       <mac address="fa:16:3e:43:c0:92"/>
Nov 08 20:34:35 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:34:35 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:34:35 user nova-compute[74638]:       <target dev="tapd6116299-16"/>
Nov 08 20:34:35 user nova-compute[74638]:     </interface>
Nov 08 20:34:35 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:34:35 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/console.log" append="off"/>
Nov 08 20:34:35 user nova-compute[74638]:     </serial>
Nov 08 20:34:35 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:34:35 user nova-compute[74638]:     <video>
Nov 08 20:34:35 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:34:35 user nova-compute[74638]:     </video>
Nov 08 20:34:35 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:34:35 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:34:35 user nova-compute[74638]:     </rng>
Nov 08 20:34:35 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:34:35 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:34:35 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:34:35 user nova-compute[74638]:     </memballoon>
Nov 08 20:34:35 user nova-compute[74638]:   </devices>
Nov 08 20:34:35 user nova-compute[74638]: </domain>
Nov 08 20:34:35 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:34:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance destroyed successfully.
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:34:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] No VIF found with MAC fa:16:3e:43:c0:92, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8f8c430-3723-4a38-badc-109f88a6a19f req-6c187b1e-7c7a-4f98-801e-8d46dc7676cd service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8f8c430-3723-4a38-badc-109f88a6a19f req-6c187b1e-7c7a-4f98-801e-8d46dc7676cd service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8f8c430-3723-4a38-badc-109f88a6a19f req-6c187b1e-7c7a-4f98-801e-8d46dc7676cd service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8f8c430-3723-4a38-badc-109f88a6a19f req-6c187b1e-7c7a-4f98-801e-8d46dc7676cd service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8f8c430-3723-4a38-badc-109f88a6a19f req-6c187b1e-7c7a-4f98-801e-8d46dc7676cd service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:37 user nova-compute[74638]: WARNING nova.compute.manager [req-f8f8c430-3723-4a38-badc-109f88a6a19f req-6c187b1e-7c7a-4f98-801e-8d46dc7676cd service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state rescuing.
Nov 08 20:34:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:40 user nova-compute[74638]: DEBUG nova.compute.manager [req-a301ee6c-b835-4539-8d5b-ea42ebf1a360 req-f707b5ee-3603-471b-be29-e5e57ae6c1c4 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:34:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a301ee6c-b835-4539-8d5b-ea42ebf1a360 req-f707b5ee-3603-471b-be29-e5e57ae6c1c4 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a301ee6c-b835-4539-8d5b-ea42ebf1a360 req-f707b5ee-3603-471b-be29-e5e57ae6c1c4 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a301ee6c-b835-4539-8d5b-ea42ebf1a360 req-f707b5ee-3603-471b-be29-e5e57ae6c1c4 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:40 user nova-compute[74638]: DEBUG nova.compute.manager [req-a301ee6c-b835-4539-8d5b-ea42ebf1a360 req-f707b5ee-3603-471b-be29-e5e57ae6c1c4 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:34:40 user nova-compute[74638]: WARNING nova.compute.manager [req-a301ee6c-b835-4539-8d5b-ea42ebf1a360 req-f707b5ee-3603-471b-be29-e5e57ae6c1c4 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state rescuing.
Nov 08 20:34:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-ebe1c1a1-6945-42ce-8d0f-2d3d03621c6e tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:34:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgOhrWdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:34:49 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:34:49 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:34:49 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52ca4c0-1057-4e80-a8fe-cacb8ff826bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:34:49 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f16de62-07c0-4e2d-a093-6f0fefe1a408]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c] added
Nov 08 20:34:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b1863-85ab-4e3b-947e-d0cdf1566c2d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e51896-7a66-4d84-a087-f17c8d765316]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgOhrWdj {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgOhrWdj" returned: 0 in 0.077s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e790b-4c14-4e6e-94b2-8fae21efe07f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgOhrWdj'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[721d3ac5-19e2-4621-9ff7-fc5171b0ebee]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e404ee2-9b85-4df1-b880-3932eafc42f9]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b924b2c7-aa9e-4631-80a1-0b54d3218781 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b924b2c7-aa9e-4631-80a1-0b54d3218781 (non-flash)
Nov 08 20:34:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b924b2c7-aa9e-4631-80a1-0b54d3218781 (non-flash)
Nov 08 20:34:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd009be-b789-4c6d-92da-87efd5e64daf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c, portal: 172.16.0.220,3260]
Nov 08 20:34:49 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c, portal: 172.16.0.220,3260] successful.
Nov 08 20:34:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a6d180-df4f-4e6c-a26c-cd5739da15a2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[143966ec-d47b-49be-8ff9-840eee017105]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b924b2c7-aa9e-4631-80a1-0b54d3218781 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b924b2c7-aa9e-4631-80a1-0b54d3218781 (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c (non-flash)
Nov 08 20:34:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b924b2c7-aa9e-4631-80a1-0b54d3218781 (non-flash)
Nov 08 20:34:49 user nova-compute[74638]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c (non-flash)
Nov 08 20:34:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.467s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[34199b74-fc2b-42a4-b2d6-26f8dcbe9dad]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:34:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:34:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:50 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:34:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgOhrWdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:34:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.506s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:34:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== connect_volume: return (1507ms) {'type': 'block', 'scsi_wwn': '23636356536343035', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:34:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636356536343035', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:34:50 user nova-compute[74638]: DEBUG nova.objects.instance [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:34:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:34:51 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:34:51 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:34:51 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:34:51 user nova-compute[74638]:   <serial>c01a8fac-5631-4a5b-a34d-55d8d4eb715c</serial>
Nov 08 20:34:51 user nova-compute[74638]: </disk>
Nov 08 20:34:51 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:34:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:34:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:34:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No VIF found with MAC fa:16:3e:46:07:49, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:34:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-de926a34-5b0a-493c-ad4a-ac3ab878446c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.616s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:34:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:34:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:34:54 user nova-compute[74638]: INFO nova.compute.manager [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Detaching volume c01a8fac-5631-4a5b-a34d-55d8d4eb715c
Nov 08 20:34:55 user nova-compute[74638]: INFO nova.virt.block_device [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attempting to driver detach volume c01a8fac-5631-4a5b-a34d-55d8d4eb715c from mountpoint /dev/vdb
Nov 08 20:34:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Attempting to detach device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:34:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:34:55 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:34:55 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:34:55 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:34:55 user nova-compute[74638]:   <serial>c01a8fac-5631-4a5b-a34d-55d8d4eb715c</serial>
Nov 08 20:34:55 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:34:55 user nova-compute[74638]: </disk>
Nov 08 20:34:55 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:34:55 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully detached device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the persistent domain config.
Nov 08 20:34:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:34:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:34:55 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:34:55 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:34:55 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:34:55 user nova-compute[74638]:   <serial>c01a8fac-5631-4a5b-a34d-55d8d4eb715c</serial>
Nov 08 20:34:55 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:34:55 user nova-compute[74638]: </disk>
Nov 08 20:34:55 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:34:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:34:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:34:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:11 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:13 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:35:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:15 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:16 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b409323-6dcf-4395-92ec-1d79b27c515b is timed out.
Nov 08 20:35:16 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully detached device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the live domain config.
Nov 08 20:35:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgOhrWdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:35:16 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd25655-a7c2-4953-9c9c-57922a75e791]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:35:16 user nova-compute[74638]: No targets found.
Nov 08 20:35:16 user nova-compute[74638]: iSNS:
Nov 08 20:35:16 user nova-compute[74638]: No targets found.
Nov 08 20:35:16 user nova-compute[74638]: STATIC:
Nov 08 20:35:16 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557
Nov 08 20:35:16 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:35:16 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:35:16 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c
Nov 08 20:35:16 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:35:16 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:35:16 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:35:16 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:35:16 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:35:16 user nova-compute[74638]: FIRMWARE:
Nov 08 20:35:16 user nova-compute[74638]: No targets found.
Nov 08 20:35:16 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:35:16 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:35:16 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[27535aba-2fdf-4ea3-9b3c-4338dee50c58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0899c7e5-9c1c-46a9-9d6a-97d63f490f36]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:35:16 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:35:16 user nova-compute[74638]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c (non-flash)
Nov 08 20:35:16 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:35:16 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:35:16 user nova-compute[74638]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c (non-flash)
Nov 08 20:35:16 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c5c9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3bcec0-f2f2-4faf-afe8-4521808756be]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[12518891-c140-42b7-ac59-ee6d6b791d57]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d2056f-580a-4874-b87d-4006e85439b4]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ec2351-98ff-4715-aa8e-14e95df0dd74]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[be255010-3838-47bf-82ab-3462aef7134d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f47c50b-20de-4a5e-9cd6-9d6c8fa05598]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c, portal: 172.16.0.220,3260]
Nov 08 20:35:16 user nova-compute[74638]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c, portal: 172.16.0.220,3260] successful.
Nov 08 20:35:16 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c01a8fac-5631-4a5b-a34d-55d8d4eb715c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd765b19-31ab-4553-89e7-f38b7a7cf0ec]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== disconnect_volume: return (312ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:35:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:17 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:35:17 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:17 user nova-compute[74638]: DEBUG nova.objects.instance [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-571be7cc-a8f3-4135-aebe-53a2a997ebba tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.182s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:20 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:35:20 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8278MB free_disk=24.908390045166016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:35:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:22 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:35:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:35:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:35:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:35:23 user nova-compute[74638]: INFO nova.compute.claims [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Claim successful on node user
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Updating instance_info_cache with network_info: [{"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:35:23 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.policy [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55df27e8271941e8ac7825d6999ce486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349308d9cb9419f9981a9d28ea61248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:35:23 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Creating image(s)
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "/opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "/opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "/opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.212s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk 1073741824" returned: 0 in 0.064s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG nova.network.neutron [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Successfully created port: 0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Cannot resize image /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Ensure instance console log exists: /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Successfully updated port: 0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-0e86d4aa-2e73-4c32-a1ff-7eb9770f7497 req-640c470a-60c1-4d1d-8ff2-be39fa1a2d88 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received event network-changed-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-0e86d4aa-2e73-4c32-a1ff-7eb9770f7497 req-640c470a-60c1-4d1d-8ff2-be39fa1a2d88 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Refreshing instance network info cache due to event network-changed-0c3018e6-09f3-4ded-9202-3400825800e6. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e86d4aa-2e73-4c32-a1ff-7eb9770f7497 req-640c470a-60c1-4d1d-8ff2-be39fa1a2d88 service nova] Acquiring lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e86d4aa-2e73-4c32-a1ff-7eb9770f7497 req-640c470a-60c1-4d1d-8ff2-be39fa1a2d88 service nova] Acquired lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.network.neutron [req-0e86d4aa-2e73-4c32-a1ff-7eb9770f7497 req-640c470a-60c1-4d1d-8ff2-be39fa1a2d88 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Refreshing network info cache for port 0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.network.neutron [req-0e86d4aa-2e73-4c32-a1ff-7eb9770f7497 req-640c470a-60c1-4d1d-8ff2-be39fa1a2d88 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.network.neutron [req-0e86d4aa-2e73-4c32-a1ff-7eb9770f7497 req-640c470a-60c1-4d1d-8ff2-be39fa1a2d88 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0e86d4aa-2e73-4c32-a1ff-7eb9770f7497 req-640c470a-60c1-4d1d-8ff2-be39fa1a2d88 service nova] Releasing lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquired lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Updating instance_info_cache with network_info: [{"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Releasing lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Instance network_info: |[{"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Start _get_guest_xml network_info=[{"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:35:25 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:35:25 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:35:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513945935',display_name='tempest-AttachVolumeNegativeTest-server-513945935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513945935',id=39,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtQtH4vm1qt6a/MZ0UGzMNbe8Q+ZsWhHhg6Nd2qcmmWaTyUkQL+bURnBc3saHGHtKVDyGRUDl4ScluTpaFG96DsS8G2tJXHHMpYss1m+AHWKNCRTVPF6FXCKXOGue1NeQ==',key_name='tempest-keypair-927949813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-g7homwth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=73254bd4-9fd9-481e-9a83-8ddeb6dd3f50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=0c3018e6-09f3-4ded-9202-3400825800e6,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3018e6-09') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.objects.instance [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'pci_devices' on Instance uuid 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:35:26 user nova-compute[74638]:   <uuid>73254bd4-9fd9-481e-9a83-8ddeb6dd3f50</uuid>
Nov 08 20:35:26 user nova-compute[74638]:   <name>instance-00000027</name>
Nov 08 20:35:26 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:35:26 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:35:26 user nova-compute[74638]:   <metadata>
Nov 08 20:35:26 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:35:26 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:35:26 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeNegativeTest-server-513945935</nova:name>
Nov 08 20:35:26 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:35:25</nova:creationTime>
Nov 08 20:35:26 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:35:26 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:35:26 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:35:26 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:35:26 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:35:26 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:35:26 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:35:26 user nova-compute[74638]:       <nova:owner>
Nov 08 20:35:26 user nova-compute[74638]:         <nova:user uuid="55df27e8271941e8ac7825d6999ce486">tempest-AttachVolumeNegativeTest-1913966386-project-member</nova:user>
Nov 08 20:35:26 user nova-compute[74638]:         <nova:project uuid="a349308d9cb9419f9981a9d28ea61248">tempest-AttachVolumeNegativeTest-1913966386</nova:project>
Nov 08 20:35:26 user nova-compute[74638]:       </nova:owner>
Nov 08 20:35:26 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:35:26 user nova-compute[74638]:       <nova:ports>
Nov 08 20:35:26 user nova-compute[74638]:         <nova:port uuid="0c3018e6-09f3-4ded-9202-3400825800e6">
Nov 08 20:35:26 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 20:35:26 user nova-compute[74638]:         </nova:port>
Nov 08 20:35:26 user nova-compute[74638]:       </nova:ports>
Nov 08 20:35:26 user nova-compute[74638]:     </nova:instance>
Nov 08 20:35:26 user nova-compute[74638]:   </metadata>
Nov 08 20:35:26 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:35:26 user nova-compute[74638]:     <system>
Nov 08 20:35:26 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:35:26 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:35:26 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:35:26 user nova-compute[74638]:       <entry name="serial">73254bd4-9fd9-481e-9a83-8ddeb6dd3f50</entry>
Nov 08 20:35:26 user nova-compute[74638]:       <entry name="uuid">73254bd4-9fd9-481e-9a83-8ddeb6dd3f50</entry>
Nov 08 20:35:26 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:35:26 user nova-compute[74638]:     </system>
Nov 08 20:35:26 user nova-compute[74638]:   </sysinfo>
Nov 08 20:35:26 user nova-compute[74638]:   <os>
Nov 08 20:35:26 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:35:26 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:35:26 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:35:26 user nova-compute[74638]:   </os>
Nov 08 20:35:26 user nova-compute[74638]:   <features>
Nov 08 20:35:26 user nova-compute[74638]:     <acpi/>
Nov 08 20:35:26 user nova-compute[74638]:     <apic/>
Nov 08 20:35:26 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:35:26 user nova-compute[74638]:   </features>
Nov 08 20:35:26 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:35:26 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:35:26 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:35:26 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:35:26 user nova-compute[74638]:   </clock>
Nov 08 20:35:26 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:35:26 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:35:26 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:35:26 user nova-compute[74638]:   </cpu>
Nov 08 20:35:26 user nova-compute[74638]:   <devices>
Nov 08 20:35:26 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:35:26 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:35:26 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk"/>
Nov 08 20:35:26 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:35:26 user nova-compute[74638]:     </disk>
Nov 08 20:35:26 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:35:26 user nova-compute[74638]:       <mac address="fa:16:3e:cb:22:8d"/>
Nov 08 20:35:26 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:35:26 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:35:26 user nova-compute[74638]:       <target dev="tap0c3018e6-09"/>
Nov 08 20:35:26 user nova-compute[74638]:     </interface>
Nov 08 20:35:26 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:35:26 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/console.log" append="off"/>
Nov 08 20:35:26 user nova-compute[74638]:     </serial>
Nov 08 20:35:26 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:35:26 user nova-compute[74638]:     <video>
Nov 08 20:35:26 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:35:26 user nova-compute[74638]:     </video>
Nov 08 20:35:26 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:35:26 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:35:26 user nova-compute[74638]:     </rng>
Nov 08 20:35:26 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:35:26 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:35:26 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:35:26 user nova-compute[74638]:     </memballoon>
Nov 08 20:35:26 user nova-compute[74638]:   </devices>
Nov 08 20:35:26 user nova-compute[74638]: </domain>
Nov 08 20:35:26 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513945935',display_name='tempest-AttachVolumeNegativeTest-server-513945935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513945935',id=39,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtQtH4vm1qt6a/MZ0UGzMNbe8Q+ZsWhHhg6Nd2qcmmWaTyUkQL+bURnBc3saHGHtKVDyGRUDl4ScluTpaFG96DsS8G2tJXHHMpYss1m+AHWKNCRTVPF6FXCKXOGue1NeQ==',key_name='tempest-keypair-927949813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-g7homwth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=73254bd4-9fd9-481e-9a83-8ddeb6dd3f50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=0c3018e6-09f3-4ded-9202-3400825800e6,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3018e6-09') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG os_vif [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=0c3018e6-09f3-4ded-9202-3400825800e6,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3018e6-09') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e96410ce-9303-58c9-8b2d-c941c8a44157', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c3018e6-09, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c3018e6-09, col_values=(('qos', UUID('fa7326bc-9fb4-4f20-aa74-9cd3865d1190')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c3018e6-09, col_values=(('external_ids', {'iface-id': '0c3018e6-09f3-4ded-9202-3400825800e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:22:8d', 'vm-uuid': '73254bd4-9fd9-481e-9a83-8ddeb6dd3f50'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:26 user nova-compute[74638]: INFO os_vif [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=0c3018e6-09f3-4ded-9202-3400825800e6,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3018e6-09')
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:35:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No VIF found with MAC fa:16:3e:cb:22:8d, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-45360c0b-0f41-413f-bcc1-7a36e7d7e219 req-07612550-06ed-45d9-bdae-3376781f1f19 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received event network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-45360c0b-0f41-413f-bcc1-7a36e7d7e219 req-07612550-06ed-45d9-bdae-3376781f1f19 service nova] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-45360c0b-0f41-413f-bcc1-7a36e7d7e219 req-07612550-06ed-45d9-bdae-3376781f1f19 service nova] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-45360c0b-0f41-413f-bcc1-7a36e7d7e219 req-07612550-06ed-45d9-bdae-3376781f1f19 service nova] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-45360c0b-0f41-413f-bcc1-7a36e7d7e219 req-07612550-06ed-45d9-bdae-3376781f1f19 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] No waiting events found dispatching network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:35:27 user nova-compute[74638]: WARNING nova.compute.manager [req-45360c0b-0f41-413f-bcc1-7a36e7d7e219 req-07612550-06ed-45d9-bdae-3376781f1f19 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received unexpected event network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 for instance with vm_state building and task_state spawning.
Nov 08 20:35:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-40d38869-66f6-429c-85e5-2b8a05ece39e req-b51542d0-00ce-437f-8e21-e8b6e41b81a3 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received event network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:35:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-40d38869-66f6-429c-85e5-2b8a05ece39e req-b51542d0-00ce-437f-8e21-e8b6e41b81a3 service nova] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:35:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-40d38869-66f6-429c-85e5-2b8a05ece39e req-b51542d0-00ce-437f-8e21-e8b6e41b81a3 service nova] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:35:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-40d38869-66f6-429c-85e5-2b8a05ece39e req-b51542d0-00ce-437f-8e21-e8b6e41b81a3 service nova] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-40d38869-66f6-429c-85e5-2b8a05ece39e req-b51542d0-00ce-437f-8e21-e8b6e41b81a3 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] No waiting events found dispatching network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:35:29 user nova-compute[74638]: WARNING nova.compute.manager [req-40d38869-66f6-429c-85e5-2b8a05ece39e req-b51542d0-00ce-437f-8e21-e8b6e41b81a3 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received unexpected event network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 for instance with vm_state building and task_state spawning.
Nov 08 20:35:29 user nova-compute[74638]: DEBUG nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:35:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:35:29 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Instance spawned successfully.
Nov 08 20:35:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:35:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:35:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:35:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:35:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:35:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:35:30 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:35:30 user nova-compute[74638]: INFO nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 08 20:35:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:35:30 user nova-compute[74638]: INFO nova.compute.manager [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Took 7.03 seconds to build instance.
Nov 08 20:35:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-857a73d5-5d34-473e-8352-2c3e4939990f tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.158s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:35:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:35:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:03 user nova-compute[74638]: INFO nova.compute.manager [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attaching volume d466f56c-9c27-44ca-a0d4-2abbcd02aa5a to /dev/vdb
Nov 08 20:36:03 user nova-compute[74638]: DEBUG os_brick.utils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d0bb2-3640-432d-a22d-43e072cada2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744b9fc-6bf1-4c37-8711-d5b2e647068d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.085s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c19ef0a-9e8b-4d1a-8a94-fd76983f9bb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50db24-5d02-4c2b-954a-35066035075c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:36:03 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:36:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc27354-a100-4cef-9bdd-f733249151d3]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG os_brick.utils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:36:03 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating existing volume attachment record: 63b3f21e-3d32-4a5c-a445-e7eb04c641c5 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:36:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:13 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:14 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:14 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:36:15 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "3d4ea789-bead-4900-81f5-b97407f89faf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "3d4ea789-bead-4900-81f5-b97407f89faf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:36:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:15 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:36:15 user nova-compute[74638]: INFO nova.compute.claims [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Claim successful on node user
Nov 08 20:36:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:16 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:36:16 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:36:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:36:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:36:16 user nova-compute[74638]: DEBUG nova.network.neutron [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:36:16 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:36:16 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:36:16 user nova-compute[74638]: INFO nova.virt.block_device [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Booting with volume snapshot 6174ac5e-ff1d-43b5-ac20-aa2de540119e at /dev/vda
Nov 08 20:36:16 user nova-compute[74638]: DEBUG nova.policy [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63d3b55213f44fbb4dd76758a9a61ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e599a20be834415ea60230b8743a2338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Successfully created port: 05a4e9d1-df47-4674-822e-1668095e1606 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Successfully updated port: 05a4e9d1-df47-4674-822e-1668095e1606 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "refresh_cache-3d4ea789-bead-4900-81f5-b97407f89faf" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquired lock "refresh_cache-3d4ea789-bead-4900-81f5-b97407f89faf" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aa0ab1e-adee-42f5-ae2a-a071d4ff0b66 req-dad8ed6c-6d13-4f9b-9539-e01c24e0798b service nova] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Received event network-changed-05a4e9d1-df47-4674-822e-1668095e1606 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-8aa0ab1e-adee-42f5-ae2a-a071d4ff0b66 req-dad8ed6c-6d13-4f9b-9539-e01c24e0798b service nova] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Refreshing instance network info cache due to event network-changed-05a4e9d1-df47-4674-822e-1668095e1606. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aa0ab1e-adee-42f5-ae2a-a071d4ff0b66 req-dad8ed6c-6d13-4f9b-9539-e01c24e0798b service nova] Acquiring lock "refresh_cache-3d4ea789-bead-4900-81f5-b97407f89faf" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:36:17 user nova-compute[74638]: DEBUG nova.network.neutron [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG nova.network.neutron [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Updating instance_info_cache with network_info: [{"id": "05a4e9d1-df47-4674-822e-1668095e1606", "address": "fa:16:3e:cf:b9:19", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a4e9d1-df", "ovs_interfaceid": "05a4e9d1-df47-4674-822e-1668095e1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Releasing lock "refresh_cache-3d4ea789-bead-4900-81f5-b97407f89faf" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Instance network_info: |[{"id": "05a4e9d1-df47-4674-822e-1668095e1606", "address": "fa:16:3e:cf:b9:19", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a4e9d1-df", "ovs_interfaceid": "05a4e9d1-df47-4674-822e-1668095e1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aa0ab1e-adee-42f5-ae2a-a071d4ff0b66 req-dad8ed6c-6d13-4f9b-9539-e01c24e0798b service nova] Acquired lock "refresh_cache-3d4ea789-bead-4900-81f5-b97407f89faf" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-8aa0ab1e-adee-42f5-ae2a-a071d4ff0b66 req-dad8ed6c-6d13-4f9b-9539-e01c24e0798b service nova] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Refreshing network info cache for port 05a4e9d1-df47-4674-822e-1668095e1606 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-8aa0ab1e-adee-42f5-ae2a-a071d4ff0b66 req-dad8ed6c-6d13-4f9b-9539-e01c24e0798b service nova] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Updated VIF entry in instance network info cache for port 05a4e9d1-df47-4674-822e-1668095e1606. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-8aa0ab1e-adee-42f5-ae2a-a071d4ff0b66 req-dad8ed6c-6d13-4f9b-9539-e01c24e0798b service nova] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Updating instance_info_cache with network_info: [{"id": "05a4e9d1-df47-4674-822e-1668095e1606", "address": "fa:16:3e:cf:b9:19", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a4e9d1-df", "ovs_interfaceid": "05a4e9d1-df47-4674-822e-1668095e1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8aa0ab1e-adee-42f5-ae2a-a071d4ff0b66 req-dad8ed6c-6d13-4f9b-9539-e01c24e0798b service nova] Releasing lock "refresh_cache-3d4ea789-bead-4900-81f5-b97407f89faf" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:36:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:21 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:36:21 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=24.867507934570312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3d4ea789-bead-4900-81f5-b97407f89faf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:36:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:22 user nova-compute[74638]: INFO nova.compute.manager [None req-be1bc0f6-ebf6-4b8f-9876-b7e36701dd6a tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Unrescuing
Nov 08 20:36:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-be1bc0f6-ebf6-4b8f-9876-b7e36701dd6a tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-be1bc0f6-ebf6-4b8f-9876-b7e36701dd6a tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquired lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-be1bc0f6-ebf6-4b8f-9876-b7e36701dd6a tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-be1bc0f6-ebf6-4b8f-9876-b7e36701dd6a tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Updating instance_info_cache with network_info: [{"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-be1bc0f6-ebf6-4b8f-9876-b7e36701dd6a tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Releasing lock "refresh_cache-685b6be0-e0d5-4af0-bdbc-699b96f5eef8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG nova.objects.instance [None req-be1bc0f6-ebf6-4b8f-9876-b7e36701dd6a tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'flavor' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-987e9493-6ccc-4982-a71c-34d3ba7e3891 req-1a6f422b-973e-4735-a147-f86e8fcdc75b service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-987e9493-6ccc-4982-a71c-34d3ba7e3891 req-1a6f422b-973e-4735-a147-f86e8fcdc75b service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-987e9493-6ccc-4982-a71c-34d3ba7e3891 req-1a6f422b-973e-4735-a147-f86e8fcdc75b service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-987e9493-6ccc-4982-a71c-34d3ba7e3891 req-1a6f422b-973e-4735-a147-f86e8fcdc75b service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-987e9493-6ccc-4982-a71c-34d3ba7e3891 req-1a6f422b-973e-4735-a147-f86e8fcdc75b service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:36:23 user nova-compute[74638]: WARNING nova.compute.manager [req-987e9493-6ccc-4982-a71c-34d3ba7e3891 req-1a6f422b-973e-4735-a147-f86e8fcdc75b service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:36:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:23 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance destroyed successfully.
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'flavor' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating instance_info_cache with network_info: [{"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:24 user nova-compute[74638]: INFO nova.compute.manager [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Attaching volume 5b65c059-6740-4162-beaa-f01ed1944d21 to /dev/vdb
Nov 08 20:36:24 user nova-compute[74638]: DEBUG os_brick.utils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[18892cc6-60db-4a67-9096-a40a9fbfcc63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[54833853-08f6-4088-84b4-590ea882a7c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a4aebf-4ec0-4be4-b1a2-efb60e9a7b30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[20370383-c6e2-4f2c-a41b-1a1cd95ddb94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:36:24 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:36:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ff08ad-147d-4fec-a2a8-830c3f29a188]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG os_brick.utils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:36:24 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating existing volume attachment record: c5860e40-7d1f-431f-b8bb-7163a25baaa8 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-36d0a7ff-c596-4a74-b4b7-93c87ad26031 req-f9c96258-01cf-4160-adc7-0c9822eb6558 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-36d0a7ff-c596-4a74-b4b7-93c87ad26031 req-f9c96258-01cf-4160-adc7-0c9822eb6558 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-36d0a7ff-c596-4a74-b4b7-93c87ad26031 req-f9c96258-01cf-4160-adc7-0c9822eb6558 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-36d0a7ff-c596-4a74-b4b7-93c87ad26031 req-f9c96258-01cf-4160-adc7-0c9822eb6558 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-36d0a7ff-c596-4a74-b4b7-93c87ad26031 req-f9c96258-01cf-4160-adc7-0c9822eb6558 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:36:25 user nova-compute[74638]: WARNING nova.compute.manager [req-36d0a7ff-c596-4a74-b4b7-93c87ad26031 req-f9c96258-01cf-4160-adc7-0c9822eb6558 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:36:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:36:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:36:27 user nova-compute[74638]: WARNING nova.compute.manager [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:36:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:36:27 user nova-compute[74638]: WARNING nova.compute.manager [req-4813f90d-4c9a-4008-abd9-50c019a158ce req-bd5ecf0f-4959-4b37-b5d9-5777197d37a7 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state rescued and task_state unrescuing.
Nov 08 20:36:27 user nova-compute[74638]: DEBUG nova.compute.manager [None req-be1bc0f6-ebf6-4b8f-9876-b7e36701dd6a tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:36:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqXLUNpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:36:42 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:36:42 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:36:42 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce062018-10b5-46a5-aa85-98c57623a760]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:36:42 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceac2fb-e1ba-4569-b7d6-6ecda295f91f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a] added
Nov 08 20:36:42 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f45a06-9f1b-45fa-bb03-8068fe105bd1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b7294f-d2c5-4fa1-8868-07c4ea6b2909]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqXLUNpT {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqXLUNpT" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdab39c-ee53-477a-aa23-e04cb5687a08]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vqXLUNpT'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:42 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0246b0f2-c590-46a6-8f0b-0af3616e47ef]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dac5c8f-cad3-435f-8630-90c22de07e88]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:36:43 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:36:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:36:43 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:36:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f26998d-bf5a-4d8a-8a88-c593920c81a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a, portal: 172.16.0.220,3260]
Nov 08 20:36:43 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a, portal: 172.16.0.220,3260] successful.
Nov 08 20:36:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4060631-46a6-4151-a7d9-0c0b843b4123]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f2c101-9c1f-4203-a5f8-09127ef0feaa]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:36:43 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:36:43 user nova-compute[74638]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)
Nov 08 20:36:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:36:43 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:36:43 user nova-compute[74638]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)
Nov 08 20:36:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[25710179-290b-4ac0-be4e-726c91b644cc]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:36:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqXLUNpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23130366365333466', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130366365333466', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:36:44 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:36:44 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:36:44 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:36:44 user nova-compute[74638]:   <serial>d466f56c-9c27-44ca-a0d4-2abbcd02aa5a</serial>
Nov 08 20:36:44 user nova-compute[74638]: </disk>
Nov 08 20:36:44 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No VIF found with MAC fa:16:3e:46:07:49, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:36:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c48b72e-8707-4e6f-9a03-dfeee1039134 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.351s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:36:47 user nova-compute[74638]: INFO nova.compute.manager [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Detaching volume d466f56c-9c27-44ca-a0d4-2abbcd02aa5a
Nov 08 20:36:47 user nova-compute[74638]: INFO nova.virt.block_device [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attempting to driver detach volume d466f56c-9c27-44ca-a0d4-2abbcd02aa5a from mountpoint /dev/vdb
Nov 08 20:36:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Attempting to detach device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:36:47 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:36:47 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:36:47 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:36:47 user nova-compute[74638]:   <serial>d466f56c-9c27-44ca-a0d4-2abbcd02aa5a</serial>
Nov 08 20:36:47 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:36:47 user nova-compute[74638]: </disk>
Nov 08 20:36:47 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:36:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully detached device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the persistent domain config.
Nov 08 20:36:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:36:47 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:36:47 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:36:47 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:36:47 user nova-compute[74638]:   <serial>d466f56c-9c27-44ca-a0d4-2abbcd02aa5a</serial>
Nov 08 20:36:47 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:36:47 user nova-compute[74638]: </disk>
Nov 08 20:36:47 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG os_brick.utils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2b2425-4046-4362-8245-6e95d3ef31de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f272b89f-2196-425b-8539-db0f7c92bc67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b431ced4-f1e4-42c9-bb3e-6c37daa39b45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2560db32-0507-4fdb-8342-c17633e50e85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:36:47 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:36:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9641ae4-af85-47c2-a8d5-fc8c4f2d3270]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG os_brick.utils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Updating existing volume attachment record: 55750da3-4004-4b21-8872-878b86d55902 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:36:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKbVGzmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:36:49 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:36:49 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:36:49 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1b1ef3-ec50-448a-9438-ae8f110e326f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:36:49 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fb6afe-8c9a-415f-9d3d-e717bc25c3fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21] added
Nov 08 20:36:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe5869-55b8-4353-8218-e8cb35a10026]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b539599-2658-46a6-a3fb-2e7a1a8b9561]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKbVGzmJ {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKbVGzmJ" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab73e921-df91-47ee-9d03-7a3fca3077c4]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKbVGzmJ'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0252b1-532b-4d00-9811-19bb42796e5a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[22718c5a-b8e5-489f-9654-e591ec4c59d1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)
Nov 08 20:36:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)
Nov 08 20:36:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[baac223c-926a-456f-9954-ae1fb0ce9eb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260]
Nov 08 20:36:49 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260] successful.
Nov 08 20:36:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d5f7cd-c17c-4644-8caf-e15d15b11f30]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[59009db8-3736-4204-9ca7-897a7912838c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:36:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)
Nov 08 20:36:49 user nova-compute[74638]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:36:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f90bc7-0a23-4abf-9508-17778c62277c]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:36:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKbVGzmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:36:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:36:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23064393864643030', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:36:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064393864643030', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:36:50 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'flavor' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:36:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:36:50 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:36:50 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:36:50 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:36:50 user nova-compute[74638]:   <serial>5b65c059-6740-4162-beaa-f01ed1944d21</serial>
Nov 08 20:36:50 user nova-compute[74638]: </disk>
Nov 08 20:36:50 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:36:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:36:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:36:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No VIF found with MAC fa:16:3e:42:24:ed, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:36:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5c92effc-e5d0-4597-a7c6-a16b28e56e94 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.182s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:36:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:36:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-f00b1e13-3ac2-46f6-b715-6afba893a180 req-5a99f2cf-64ef-455b-8e01-7db6a80a13a6 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-f00b1e13-3ac2-46f6-b715-6afba893a180 req-5a99f2cf-64ef-455b-8e01-7db6a80a13a6 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing instance network info cache due to event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:37:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f00b1e13-3ac2-46f6-b715-6afba893a180 req-5a99f2cf-64ef-455b-8e01-7db6a80a13a6 service nova] Acquiring lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:37:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f00b1e13-3ac2-46f6-b715-6afba893a180 req-5a99f2cf-64ef-455b-8e01-7db6a80a13a6 service nova] Acquired lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:37:05 user nova-compute[74638]: DEBUG nova.network.neutron [req-f00b1e13-3ac2-46f6-b715-6afba893a180 req-5a99f2cf-64ef-455b-8e01-7db6a80a13a6 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:37:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:37:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-f00b1e13-3ac2-46f6-b715-6afba893a180 req-5a99f2cf-64ef-455b-8e01-7db6a80a13a6 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updated VIF entry in instance network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:37:06 user nova-compute[74638]: DEBUG nova.network.neutron [req-f00b1e13-3ac2-46f6-b715-6afba893a180 req-5a99f2cf-64ef-455b-8e01-7db6a80a13a6 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:37:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f00b1e13-3ac2-46f6-b715-6afba893a180 req-5a99f2cf-64ef-455b-8e01-7db6a80a13a6 service nova] Releasing lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:37:07 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b409323-6dcf-4395-92ec-1d79b27c515b is timed out.
Nov 08 20:37:07 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully detached device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the live domain config.
Nov 08 20:37:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqXLUNpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:37:07 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd27c1c6-84fa-4ce3-abe6-6e0e04293036]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:37:07 user nova-compute[74638]: No targets found.
Nov 08 20:37:07 user nova-compute[74638]: iSNS:
Nov 08 20:37:07 user nova-compute[74638]: No targets found.
Nov 08 20:37:07 user nova-compute[74638]: STATIC:
Nov 08 20:37:07 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21
Nov 08 20:37:07 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:37:07 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:37:07 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557
Nov 08 20:37:07 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:37:07 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:37:07 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a
Nov 08 20:37:07 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:37:07 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:37:07 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:37:07 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:37:07 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:37:07 user nova-compute[74638]: FIRMWARE:
Nov 08 20:37:07 user nova-compute[74638]: No targets found.
Nov 08 20:37:07 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:37:07 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:37:07 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[95212638-4115-48b8-912f-94ee7ed4df49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a0370-e35b-4eeb-b324-5233545f291c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:37:07 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:37:07 user nova-compute[74638]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)
Nov 08 20:37:07 user nova-compute[74638]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:37:07 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:37:07 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:37:07 user nova-compute[74638]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a (non-flash)
Nov 08 20:37:07 user nova-compute[74638]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:37:07 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3e4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ac11a-fb84-4859-9b29-04f07ae12ef4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee60ae-07fe-44eb-91a0-63448a505442]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ffce6-f1d9-4208-8cf6-d52aab663f86]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3a1d41-85ab-4eb2-8064-1c99f5315dc5]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c60a2ae-1f30-4333-b4a4-a679fe6cf30a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f5f1d7-a13a-4e1f-a2af-b38322dd073b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a, portal: 172.16.0.220,3260]
Nov 08 20:37:08 user nova-compute[74638]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a, portal: 172.16.0.220,3260] successful.
Nov 08 20:37:08 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d466f56c-9c27-44ca-a0d4-2abbcd02aa5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ef9614-ad2d-498d-a49f-e4dfe022b9eb]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== disconnect_volume: return (330ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-a85e0c08-3c56-4178-b498-ae2c37cc6e9d req-7e249b03-5195-4f61-a0f5-dca6d80ff3ae service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-a85e0c08-3c56-4178-b498-ae2c37cc6e9d req-7e249b03-5195-4f61-a0f5-dca6d80ff3ae service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing instance network info cache due to event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a85e0c08-3c56-4178-b498-ae2c37cc6e9d req-7e249b03-5195-4f61-a0f5-dca6d80ff3ae service nova] Acquiring lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a85e0c08-3c56-4178-b498-ae2c37cc6e9d req-7e249b03-5195-4f61-a0f5-dca6d80ff3ae service nova] Acquired lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG nova.network.neutron [req-a85e0c08-3c56-4178-b498-ae2c37cc6e9d req-7e249b03-5195-4f61-a0f5-dca6d80ff3ae service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG nova.network.neutron [req-a85e0c08-3c56-4178-b498-ae2c37cc6e9d req-7e249b03-5195-4f61-a0f5-dca6d80ff3ae service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updated VIF entry in instance network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG nova.network.neutron [req-a85e0c08-3c56-4178-b498-ae2c37cc6e9d req-7e249b03-5195-4f61-a0f5-dca6d80ff3ae service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:37:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a85e0c08-3c56-4178-b498-ae2c37cc6e9d req-7e249b03-5195-4f61-a0f5-dca6d80ff3ae service nova] Releasing lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:37:09 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:37:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c6cd62e3-b31e-419b-8e87-c41208db626c tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.volume.cinder [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Update attachment failed for attachment 55750da3-4004-4b21-8872-878b86d55902. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ca428271-f3d7-42a6-8a8d-c62f9e792c43) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ca428271-f3d7-42a6-8a8d-c62f9e792c43)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ca428271-f3d7-42a6-8a8d-c62f9e792c43)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Traceback (most recent call last):
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     driver_block_device.attach_block_devices(
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     _log_and_attach(device)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     bdm.attach(*attach_args, **attach_kwargs)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/virt/block_device.py", line 819, in attach
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     super(DriverVolSnapshotBlockDevice, self).attach(
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     self._do_attach(context, instance, volume, volume_api,
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     self._volume_attach(context, volume, connector, instance,
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     connection_info = volume_api.attachment_update(
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     res = method(self, ctx, *args, **kwargs)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     with excutils.save_and_reraise_exception():
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     self.force_reraise()
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     raise self.value
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     return method.func(obj, *args, **kwargs)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     resp = self._update('/attachments/%s' % id, body)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     return self.request(url, method, **kwargs)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf]     raise exceptions.from_response(resp, body)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ca428271-f3d7-42a6-8a8d-c62f9e792c43)
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] 
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.compute.claims [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Aborting claim: <nova.compute.claims.Claim object at 0x7fe54c4535b0> {{(pid=74638) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.465s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Build of instance 3d4ea789-bead-4900-81f5-b97407f89faf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ca428271-f3d7-42a6-8a8d-c62f9e792c43) {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.compute.utils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Build of instance 3d4ea789-bead-4900-81f5-b97407f89faf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74638) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 08 20:37:13 user nova-compute[74638]: ERROR nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Build of instance 3d4ea789-bead-4900-81f5-b97407f89faf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ca428271-f3d7-42a6-8a8d-c62f9e792c43): nova.exception.BuildAbortException: Build of instance 3d4ea789-bead-4900-81f5-b97407f89faf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ca428271-f3d7-42a6-8a8d-c62f9e792c43)
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Unplugging VIFs for instance {{(pid=74638) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-765880330',display_name='tempest-TestVolumeBootPattern-server-765880330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-765880330',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-z7hul7ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:36:16Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=3d4ea789-bead-4900-81f5-b97407f89faf,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a4e9d1-df47-4674-822e-1668095e1606", "address": "fa:16:3e:cf:b9:19", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a4e9d1-df", "ovs_interfaceid": "05a4e9d1-df47-4674-822e-1668095e1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "05a4e9d1-df47-4674-822e-1668095e1606", "address": "fa:16:3e:cf:b9:19", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a4e9d1-df", "ovs_interfaceid": "05a4e9d1-df47-4674-822e-1668095e1606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b9:19,bridge_name='br-int',has_traffic_filtering=True,id=05a4e9d1-df47-4674-822e-1668095e1606,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a4e9d1-df') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG os_vif [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b9:19,bridge_name='br-int',has_traffic_filtering=True,id=05a4e9d1-df47-4674-822e-1668095e1606,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a4e9d1-df') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05a4e9d1-df, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:37:13 user nova-compute[74638]: INFO os_vif [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:b9:19,bridge_name='br-int',has_traffic_filtering=True,id=05a4e9d1-df47-4674-822e-1668095e1606,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a4e9d1-df')
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Unplugged VIFs for instance {{(pid=74638) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:37:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:37:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:14 user nova-compute[74638]: DEBUG nova.network.neutron [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:37:14 user nova-compute[74638]: INFO nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Took 1.20 seconds to deallocate network for instance.
Nov 08 20:37:14 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Detaching volume: 05633b75-0a8a-4005-a868-93a414e49b82 {{(pid=74638) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 08 20:37:14 user nova-compute[74638]: INFO nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Detaching volume 05633b75-0a8a-4005-a868-93a414e49b82
Nov 08 20:37:15 user nova-compute[74638]: ERROR nova.virt.block_device [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Unable to call for a driver detach of volume 05633b75-0a8a-4005-a868-93a414e49b82 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 3d4ea789-bead-4900-81f5-b97407f89faf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ca428271-f3d7-42a6-8a8d-c62f9e792c43)
Nov 08 20:37:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 3d4ea789-bead-4900-81f5-b97407f89faf] Deleting volume: 05633b75-0a8a-4005-a868-93a414e49b82 {{(pid=74638) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 20:37:15 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Deleted allocations for instance 3d4ea789-bead-4900-81f5-b97407f89faf
Nov 08 20:37:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-82b70371-d6ad-45bd-8125-2ec2808f07ce tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "3d4ea789-bead-4900-81f5-b97407f89faf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 59.650s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:15 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:15 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:15 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:37:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-b66274c5-44cd-46ce-8189-ca9fab34b80d req-ce9f3250-408e-4a6f-ab10-a803c1913c7e service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received event network-changed-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-b66274c5-44cd-46ce-8189-ca9fab34b80d req-ce9f3250-408e-4a6f-ab10-a803c1913c7e service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Refreshing instance network info cache due to event network-changed-0c3018e6-09f3-4ded-9202-3400825800e6. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:37:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b66274c5-44cd-46ce-8189-ca9fab34b80d req-ce9f3250-408e-4a6f-ab10-a803c1913c7e service nova] Acquiring lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:37:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b66274c5-44cd-46ce-8189-ca9fab34b80d req-ce9f3250-408e-4a6f-ab10-a803c1913c7e service nova] Acquired lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:37:16 user nova-compute[74638]: DEBUG nova.network.neutron [req-b66274c5-44cd-46ce-8189-ca9fab34b80d req-ce9f3250-408e-4a6f-ab10-a803c1913c7e service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Refreshing network info cache for port 0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:37:17 user nova-compute[74638]: DEBUG nova.network.neutron [req-b66274c5-44cd-46ce-8189-ca9fab34b80d req-ce9f3250-408e-4a6f-ab10-a803c1913c7e service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Updated VIF entry in instance network info cache for port 0c3018e6-09f3-4ded-9202-3400825800e6. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:37:17 user nova-compute[74638]: DEBUG nova.network.neutron [req-b66274c5-44cd-46ce-8189-ca9fab34b80d req-ce9f3250-408e-4a6f-ab10-a803c1913c7e service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Updating instance_info_cache with network_info: [{"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:37:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b66274c5-44cd-46ce-8189-ca9fab34b80d req-ce9f3250-408e-4a6f-ab10-a803c1913c7e service nova] Releasing lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:37:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:20 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:21 user nova-compute[74638]: INFO nova.compute.manager [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Rebooting instance
Nov 08 20:37:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquired lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:37:22 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:37:22 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8233MB free_disk=24.856746673583984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Releasing lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-14645a53-55ed-4b0b-808e-ff9e26032f8b req-e13998c6-0020-4e71-9cc7-d8580c08ec0d service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-unplugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-14645a53-55ed-4b0b-808e-ff9e26032f8b req-e13998c6-0020-4e71-9cc7-d8580c08ec0d service nova] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-14645a53-55ed-4b0b-808e-ff9e26032f8b req-e13998c6-0020-4e71-9cc7-d8580c08ec0d service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-14645a53-55ed-4b0b-808e-ff9e26032f8b req-e13998c6-0020-4e71-9cc7-d8580c08ec0d service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-14645a53-55ed-4b0b-808e-ff9e26032f8b req-e13998c6-0020-4e71-9cc7-d8580c08ec0d service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] No waiting events found dispatching network-vif-unplugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:37:23 user nova-compute[74638]: WARNING nova.compute.manager [req-14645a53-55ed-4b0b-808e-ff9e26032f8b req-e13998c6-0020-4e71-9cc7-d8580c08ec0d service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received unexpected event network-vif-unplugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a for instance with vm_state active and task_state reboot_started_hard.
Nov 08 20:37:23 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Instance destroyed successfully.
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.objects.instance [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'resources' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1325662292',display_name='tempest-TestMinimumBasicScenario-server-1325662292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1325662292',id=38,image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCPi1E0igEFZIdJhZePk4DFeVJRb0sGuZNECAaBx8cK2GZaERHs7lvKuVpUC4dqiBhtTTuoqxTWClMijGvMvsL9sYx84lTEJSNMJFUnoSzDfmc6zIJbGw39SqU9mhTrQ==',key_name='tempest-TestMinimumBasicScenario-551223592',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:34:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-btomml66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:37:23Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=d6a4f12a-a033-461a-82c0-157b2be2dcd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:37:23 user nova-compute[74638]: DEBUG os_vif [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f99d813-1d, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9426e56c-fd73-4450-a2df-907ddd9c0681) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:37:24 user nova-compute[74638]: INFO os_vif [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d')
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKbVGzmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:37:24 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ddc6b-d36a-4633-ba15-974fc8cc1080]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:37:24 user nova-compute[74638]: No targets found.
Nov 08 20:37:24 user nova-compute[74638]: iSNS:
Nov 08 20:37:24 user nova-compute[74638]: No targets found.
Nov 08 20:37:24 user nova-compute[74638]: STATIC:
Nov 08 20:37:24 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21
Nov 08 20:37:24 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:37:24 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:37:24 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557
Nov 08 20:37:24 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:37:24 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:37:24 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:37:24 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:37:24 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:37:24 user nova-compute[74638]: FIRMWARE:
Nov 08 20:37:24 user nova-compute[74638]: No targets found.
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:37:24 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:37:24 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e766dd-b76e-4111-8f6c-9b9ef55d5524]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd500dad-d378-43ec-a040-97664eeed2e3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe555de0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[271ace49-3889-40ca-bf99-32ef1f53b776]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d774aa5-2314-45ae-b410-41e7d607d7ea]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef25550-cdfe-4135-ab0c-243b8d522c65]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2438fa6f-50d1-43a4-bd92-5496ab1d284c]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b68bfc-e8c3-46e2-a0ed-20b2e9203de0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61dbe2b-8a84-4f47-8bd2-7d337d83bc0c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260]
Nov 08 20:37:24 user nova-compute[74638]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260] successful.
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c27923-c7f3-4323-af39-8559814bef3d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] <== disconnect_volume: return (322ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Start _get_guest_xml network_info=[{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ae1b1a07-db61-49ca-b03a-0c7257589e84,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'ae1b1a07-db61-49ca-b03a-0c7257589e84'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'c5860e40-7d1f-431f-b8bb-7163a25baaa8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKbVGzmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd6a4f12a-a033-461a-82c0-157b2be2dcd8', 'attached_at': '', 'detached_at': '', 'volume_id': '5b65c059-6740-4162-beaa-f01ed1944d21', 'serial': '5b65c059-6740-4162-beaa-f01ed1944d21'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:37:24 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:37:24 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ae1b1a07-db61-49ca-b03a-0c7257589e84,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.objects.instance [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.objects.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Object Instance<d6a4f12a-a033-461a-82c0-157b2be2dcd8> lazy-loaded attributes: resources,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKbVGzmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:37:24 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:37:24 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:37:24 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8da8d7-bfb3-43dc-9803-bd8f9bb95012]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:37:24 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[88866d2c-3a28-4263-85c0-a58f94c4312a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21] added
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf8326b-ecec-43b3-8b45-64d306664189]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bed7dd-7a3d-4bbc-92b6-91bbbf9d18b0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKbVGzmJ {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKbVGzmJ" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae8d53b-bcbf-4f72-b846-00cfa53753e2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKbVGzmJ'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2abdee-fe26-4aec-b73f-327c59555e97]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06e25bb-1986-4dde-bf52-3a48bad7dfde]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe26c18-fc1b-44c1-9af5-80000f2fadf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260]
Nov 08 20:37:24 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260] successful.
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e27f63-e154-432b-a00b-bcd5a95b098f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6146382b-cd0a-45b2-b80b-5cda6d79bed0]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:37:24 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e1d263-ecb1-4337-998a-d5d18817ea1f]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:37:24 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKbVGzmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-05b1342e-58e1-4faf-a7ab-c23c8962e2c9 req-54766a34-dc9d-44af-93c5-3a522f48ee62 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-05b1342e-58e1-4faf-a7ab-c23c8962e2c9 req-54766a34-dc9d-44af-93c5-3a522f48ee62 service nova] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-05b1342e-58e1-4faf-a7ab-c23c8962e2c9 req-54766a34-dc9d-44af-93c5-3a522f48ee62 service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-05b1342e-58e1-4faf-a7ab-c23c8962e2c9 req-54766a34-dc9d-44af-93c5-3a522f48ee62 service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.compute.manager [req-05b1342e-58e1-4faf-a7ab-c23c8962e2c9 req-54766a34-dc9d-44af-93c5-3a522f48ee62 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] No waiting events found dispatching network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:37:25 user nova-compute[74638]: WARNING nova.compute.manager [req-05b1342e-58e1-4faf-a7ab-c23c8962e2c9 req-54766a34-dc9d-44af-93c5-3a522f48ee62 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received unexpected event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a for instance with vm_state active and task_state reboot_started_hard.
Nov 08 20:37:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23064393864643030', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064393864643030', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1325662292',display_name='tempest-TestMinimumBasicScenario-server-1325662292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1325662292',id=38,image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCPi1E0igEFZIdJhZePk4DFeVJRb0sGuZNECAaBx8cK2GZaERHs7lvKuVpUC4dqiBhtTTuoqxTWClMijGvMvsL9sYx84lTEJSNMJFUnoSzDfmc6zIJbGw39SqU9mhTrQ==',key_name='tempest-TestMinimumBasicScenario-551223592',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:34:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-btomml66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:37:23Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=d6a4f12a-a033-461a-82c0-157b2be2dcd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.objects.instance [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'pci_devices' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.objects.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Object Instance<d6a4f12a-a033-461a-82c0-157b2be2dcd8> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:37:25 user nova-compute[74638]:   <uuid>d6a4f12a-a033-461a-82c0-157b2be2dcd8</uuid>
Nov 08 20:37:25 user nova-compute[74638]:   <name>instance-00000026</name>
Nov 08 20:37:25 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:37:25 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:37:25 user nova-compute[74638]:   <metadata>
Nov 08 20:37:25 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:37:25 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:37:25 user nova-compute[74638]:       <nova:name>tempest-TestMinimumBasicScenario-server-1325662292</nova:name>
Nov 08 20:37:25 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:37:24</nova:creationTime>
Nov 08 20:37:25 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:37:25 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:37:25 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:37:25 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:37:25 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:37:25 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:37:25 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:37:25 user nova-compute[74638]:       <nova:owner>
Nov 08 20:37:25 user nova-compute[74638]:         <nova:user uuid="055e6d6be11a4365af65a6f5090eee90">tempest-TestMinimumBasicScenario-1423913344-project-member</nova:user>
Nov 08 20:37:25 user nova-compute[74638]:         <nova:project uuid="45c12f4f25aa40889f55cc73ac02a098">tempest-TestMinimumBasicScenario-1423913344</nova:project>
Nov 08 20:37:25 user nova-compute[74638]:       </nova:owner>
Nov 08 20:37:25 user nova-compute[74638]:       <nova:root type="image" uuid="ae1b1a07-db61-49ca-b03a-0c7257589e84"/>
Nov 08 20:37:25 user nova-compute[74638]:       <nova:ports>
Nov 08 20:37:25 user nova-compute[74638]:         <nova:port uuid="6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a">
Nov 08 20:37:25 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 20:37:25 user nova-compute[74638]:         </nova:port>
Nov 08 20:37:25 user nova-compute[74638]:       </nova:ports>
Nov 08 20:37:25 user nova-compute[74638]:     </nova:instance>
Nov 08 20:37:25 user nova-compute[74638]:   </metadata>
Nov 08 20:37:25 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:37:25 user nova-compute[74638]:     <system>
Nov 08 20:37:25 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:37:25 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:37:25 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:37:25 user nova-compute[74638]:       <entry name="serial">d6a4f12a-a033-461a-82c0-157b2be2dcd8</entry>
Nov 08 20:37:25 user nova-compute[74638]:       <entry name="uuid">d6a4f12a-a033-461a-82c0-157b2be2dcd8</entry>
Nov 08 20:37:25 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:37:25 user nova-compute[74638]:     </system>
Nov 08 20:37:25 user nova-compute[74638]:   </sysinfo>
Nov 08 20:37:25 user nova-compute[74638]:   <os>
Nov 08 20:37:25 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:37:25 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:37:25 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:37:25 user nova-compute[74638]:   </os>
Nov 08 20:37:25 user nova-compute[74638]:   <features>
Nov 08 20:37:25 user nova-compute[74638]:     <acpi/>
Nov 08 20:37:25 user nova-compute[74638]:     <apic/>
Nov 08 20:37:25 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:37:25 user nova-compute[74638]:   </features>
Nov 08 20:37:25 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:37:25 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:37:25 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:37:25 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:37:25 user nova-compute[74638]:   </clock>
Nov 08 20:37:25 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:37:25 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:37:25 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:37:25 user nova-compute[74638]:   </cpu>
Nov 08 20:37:25 user nova-compute[74638]:   <devices>
Nov 08 20:37:25 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:37:25 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:37:25 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk"/>
Nov 08 20:37:25 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:37:25 user nova-compute[74638]:     </disk>
Nov 08 20:37:25 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:37:25 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:37:25 user nova-compute[74638]:       <source dev="/dev/sdc"/>
Nov 08 20:37:25 user nova-compute[74638]:       <target dev="vdb" bus="virtio"/>
Nov 08 20:37:25 user nova-compute[74638]:       <serial>5b65c059-6740-4162-beaa-f01ed1944d21</serial>
Nov 08 20:37:25 user nova-compute[74638]:     </disk>
Nov 08 20:37:25 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:37:25 user nova-compute[74638]:       <mac address="fa:16:3e:42:24:ed"/>
Nov 08 20:37:25 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:37:25 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:37:25 user nova-compute[74638]:       <target dev="tap6f99d813-1d"/>
Nov 08 20:37:25 user nova-compute[74638]:     </interface>
Nov 08 20:37:25 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:37:25 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/console.log" append="off"/>
Nov 08 20:37:25 user nova-compute[74638]:     </serial>
Nov 08 20:37:25 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:37:25 user nova-compute[74638]:     <video>
Nov 08 20:37:25 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:37:25 user nova-compute[74638]:     </video>
Nov 08 20:37:25 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:37:25 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:37:25 user nova-compute[74638]:     </rng>
Nov 08 20:37:25 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:37:25 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:37:25 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:37:25 user nova-compute[74638]:     </memballoon>
Nov 08 20:37:25 user nova-compute[74638]:   </devices>
Nov 08 20:37:25 user nova-compute[74638]: </domain>
Nov 08 20:37:25 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:37:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.objects.instance [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'trusted_certs' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.objects.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Object Instance<d6a4f12a-a033-461a-82c0-157b2be2dcd8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Cannot resize image /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.objects.instance [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'migration_context' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.objects.base [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Object Instance<d6a4f12a-a033-461a-82c0-157b2be2dcd8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1325662292',display_name='tempest-TestMinimumBasicScenario-server-1325662292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1325662292',id=38,image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCPi1E0igEFZIdJhZePk4DFeVJRb0sGuZNECAaBx8cK2GZaERHs7lvKuVpUC4dqiBhtTTuoqxTWClMijGvMvsL9sYx84lTEJSNMJFUnoSzDfmc6zIJbGw39SqU9mhTrQ==',key_name='tempest-TestMinimumBasicScenario-551223592',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:34:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-btomml66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:37:23Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=d6a4f12a-a033-461a-82c0-157b2be2dcd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG os_vif [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9db02c8b-f160-5c40-9f63-0727eeceefdd', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f99d813-1d, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f99d813-1d, col_values=(('qos', UUID('5f1d59ae-8b3e-4dd2-9964-a088f33e39c9')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f99d813-1d, col_values=(('external_ids', {'iface-id': '6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:24:ed', 'vm-uuid': 'd6a4f12a-a033-461a-82c0-157b2be2dcd8'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:26 user nova-compute[74638]: INFO os_vif [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d')
Nov 08 20:37:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-7d1fe008-ad46-4b28-9375-2d6926fcc752 req-b6e5bef3-135a-4747-a0c8-b58a0d1cc0a2 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7d1fe008-ad46-4b28-9375-2d6926fcc752 req-b6e5bef3-135a-4747-a0c8-b58a0d1cc0a2 service nova] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7d1fe008-ad46-4b28-9375-2d6926fcc752 req-b6e5bef3-135a-4747-a0c8-b58a0d1cc0a2 service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7d1fe008-ad46-4b28-9375-2d6926fcc752 req-b6e5bef3-135a-4747-a0c8-b58a0d1cc0a2 service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG nova.compute.manager [req-7d1fe008-ad46-4b28-9375-2d6926fcc752 req-b6e5bef3-135a-4747-a0c8-b58a0d1cc0a2 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] No waiting events found dispatching network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:37:28 user nova-compute[74638]: WARNING nova.compute.manager [req-7d1fe008-ad46-4b28-9375-2d6926fcc752 req-b6e5bef3-135a-4747-a0c8-b58a0d1cc0a2 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received unexpected event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a for instance with vm_state active and task_state reboot_started_hard.
Nov 08 20:37:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:37:30 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Instance rebooted successfully.
Nov 08 20:37:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:37:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-d16e05e1-09f5-431e-9945-145e3c628916 req-c92e5b21-00fa-4d7b-8eea-cba2d1a4a0dc service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d16e05e1-09f5-431e-9945-145e3c628916 req-c92e5b21-00fa-4d7b-8eea-cba2d1a4a0dc service nova] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d16e05e1-09f5-431e-9945-145e3c628916 req-c92e5b21-00fa-4d7b-8eea-cba2d1a4a0dc service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d16e05e1-09f5-431e-9945-145e3c628916 req-c92e5b21-00fa-4d7b-8eea-cba2d1a4a0dc service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-d16e05e1-09f5-431e-9945-145e3c628916 req-c92e5b21-00fa-4d7b-8eea-cba2d1a4a0dc service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] No waiting events found dispatching network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:37:30 user nova-compute[74638]: WARNING nova.compute.manager [req-d16e05e1-09f5-431e-9945-145e3c628916 req-c92e5b21-00fa-4d7b-8eea-cba2d1a4a0dc service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received unexpected event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a for instance with vm_state active and task_state reboot_started_hard.
Nov 08 20:37:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-65208022-32ed-4b88-8aa6-bf5a63fa0d8f tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.652s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:32 user nova-compute[74638]: DEBUG nova.objects.instance [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:37:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:37:33 user nova-compute[74638]: INFO nova.compute.claims [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Claim successful on node user
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:33 user nova-compute[74638]: INFO nova.compute.manager [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Attaching volume 4681c825-1c73-47eb-9dac-0bc4861e7b7f to /dev/vdb
Nov 08 20:37:33 user nova-compute[74638]: DEBUG os_brick.utils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f22ec3-3302-4e69-93b3-6295ed8f6429]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff4c5b9-8e4a-45bd-933f-1433fe52f704]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[002b7f44-7392-4581-a958-5ae16a94f1f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[de300a07-0da1-45d7-abf7-2527ab504609]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:37:33 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f898d3-327a-4ec4-a002-aa79f7e90650]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG os_brick.utils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Updating existing volume attachment record: 869ddcf3-f80e-4e97-8580-27d41ec80d95 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:37:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:37:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG nova.policy [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05842022c6fe4a02b2a5d4ff1bae8825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf0f58077f44ca890858170ed8b1a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:37:34 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Creating image(s)
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "/opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "/opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.215s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.198s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk 1073741824" returned: 0 in 0.061s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.210s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:37:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:37:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:37:35 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Cannot resize image /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:37:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:37:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Ensure instance console log exists: /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:37:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:35 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Successfully created port: e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Successfully updated port: e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquired lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-6958a2ee-69ae-4e30-99ae-2d3695fee2b8 req-26746f9d-2ade-4ff5-94da-41fc0517939c service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received event network-changed-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-6958a2ee-69ae-4e30-99ae-2d3695fee2b8 req-26746f9d-2ade-4ff5-94da-41fc0517939c service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Refreshing instance network info cache due to event network-changed-e7e6b658-d441-4491-90dc-91a5ab29d006. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6958a2ee-69ae-4e30-99ae-2d3695fee2b8 req-26746f9d-2ade-4ff5-94da-41fc0517939c service nova] Acquiring lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updating instance_info_cache with network_info: [{"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Releasing lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Instance network_info: |[{"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6958a2ee-69ae-4e30-99ae-2d3695fee2b8 req-26746f9d-2ade-4ff5-94da-41fc0517939c service nova] Acquired lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.neutron [req-6958a2ee-69ae-4e30-99ae-2d3695fee2b8 req-26746f9d-2ade-4ff5-94da-41fc0517939c service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Refreshing network info cache for port e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Start _get_guest_xml network_info=[{"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:37:36 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:37:36 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1271273190',display_name='tempest-TestServerVolumeAttachmentScenario-server-1271273190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1271273190',id=41,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmnr6SxFcRAp0IZQiyqHzp0EnyU0AC626lPjgBXqH+Q24qS4nCPRsgra3C3PD6K854Bm+bgozdV/BmkOa3Ov7lu56SwP7xIX3S2DbyHe572slLiWZicYoaG/ZD5zHBFSQ==',key_name='tempest-keypair-579774605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adf0f58077f44ca890858170ed8b1a1d',ramdisk_id='',reservation_id='r-p7usrme9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-710922255',owner_user_name='tempest-TestServerVolumeAttachmentScenario-710922255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:37:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05842022c6fe4a02b2a5d4ff1bae8825',uuid=8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Converting VIF {"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:dc:33,bridge_name='br-int',has_traffic_filtering=True,id=e7e6b658-d441-4491-90dc-91a5ab29d006,network=Network(0252b2da-ee01-41bf-8462-d421013510b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e6b658-d4') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.objects.instance [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:37:36 user nova-compute[74638]:   <uuid>8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d</uuid>
Nov 08 20:37:36 user nova-compute[74638]:   <name>instance-00000029</name>
Nov 08 20:37:36 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:37:36 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:37:36 user nova-compute[74638]:   <metadata>
Nov 08 20:37:36 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:37:36 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:37:36 user nova-compute[74638]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1271273190</nova:name>
Nov 08 20:37:36 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:37:36</nova:creationTime>
Nov 08 20:37:36 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:37:36 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:37:36 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:37:36 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:37:36 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:37:36 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:37:36 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:37:36 user nova-compute[74638]:       <nova:owner>
Nov 08 20:37:36 user nova-compute[74638]:         <nova:user uuid="05842022c6fe4a02b2a5d4ff1bae8825">tempest-TestServerVolumeAttachmentScenario-710922255-project-member</nova:user>
Nov 08 20:37:36 user nova-compute[74638]:         <nova:project uuid="adf0f58077f44ca890858170ed8b1a1d">tempest-TestServerVolumeAttachmentScenario-710922255</nova:project>
Nov 08 20:37:36 user nova-compute[74638]:       </nova:owner>
Nov 08 20:37:36 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:37:36 user nova-compute[74638]:       <nova:ports>
Nov 08 20:37:36 user nova-compute[74638]:         <nova:port uuid="e7e6b658-d441-4491-90dc-91a5ab29d006">
Nov 08 20:37:36 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 20:37:36 user nova-compute[74638]:         </nova:port>
Nov 08 20:37:36 user nova-compute[74638]:       </nova:ports>
Nov 08 20:37:36 user nova-compute[74638]:     </nova:instance>
Nov 08 20:37:36 user nova-compute[74638]:   </metadata>
Nov 08 20:37:36 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:37:36 user nova-compute[74638]:     <system>
Nov 08 20:37:36 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:37:36 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:37:36 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:37:36 user nova-compute[74638]:       <entry name="serial">8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d</entry>
Nov 08 20:37:36 user nova-compute[74638]:       <entry name="uuid">8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d</entry>
Nov 08 20:37:36 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:37:36 user nova-compute[74638]:     </system>
Nov 08 20:37:36 user nova-compute[74638]:   </sysinfo>
Nov 08 20:37:36 user nova-compute[74638]:   <os>
Nov 08 20:37:36 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:37:36 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:37:36 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:37:36 user nova-compute[74638]:   </os>
Nov 08 20:37:36 user nova-compute[74638]:   <features>
Nov 08 20:37:36 user nova-compute[74638]:     <acpi/>
Nov 08 20:37:36 user nova-compute[74638]:     <apic/>
Nov 08 20:37:36 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:37:36 user nova-compute[74638]:   </features>
Nov 08 20:37:36 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:37:36 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:37:36 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:37:36 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:37:36 user nova-compute[74638]:   </clock>
Nov 08 20:37:36 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:37:36 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:37:36 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:37:36 user nova-compute[74638]:   </cpu>
Nov 08 20:37:36 user nova-compute[74638]:   <devices>
Nov 08 20:37:36 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:37:36 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:37:36 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk"/>
Nov 08 20:37:36 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:37:36 user nova-compute[74638]:     </disk>
Nov 08 20:37:36 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:37:36 user nova-compute[74638]:       <mac address="fa:16:3e:57:dc:33"/>
Nov 08 20:37:36 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:37:36 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:37:36 user nova-compute[74638]:       <target dev="tape7e6b658-d4"/>
Nov 08 20:37:36 user nova-compute[74638]:     </interface>
Nov 08 20:37:36 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:37:36 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/console.log" append="off"/>
Nov 08 20:37:36 user nova-compute[74638]:     </serial>
Nov 08 20:37:36 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:37:36 user nova-compute[74638]:     <video>
Nov 08 20:37:36 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:37:36 user nova-compute[74638]:     </video>
Nov 08 20:37:36 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:37:36 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:37:36 user nova-compute[74638]:     </rng>
Nov 08 20:37:36 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:37:36 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:37:36 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:37:36 user nova-compute[74638]:     </memballoon>
Nov 08 20:37:36 user nova-compute[74638]:   </devices>
Nov 08 20:37:36 user nova-compute[74638]: </domain>
Nov 08 20:37:36 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1271273190',display_name='tempest-TestServerVolumeAttachmentScenario-server-1271273190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1271273190',id=41,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmnr6SxFcRAp0IZQiyqHzp0EnyU0AC626lPjgBXqH+Q24qS4nCPRsgra3C3PD6K854Bm+bgozdV/BmkOa3Ov7lu56SwP7xIX3S2DbyHe572slLiWZicYoaG/ZD5zHBFSQ==',key_name='tempest-keypair-579774605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adf0f58077f44ca890858170ed8b1a1d',ramdisk_id='',reservation_id='r-p7usrme9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-710922255',owner_user_name='tempest-TestServerVolumeAttachmentScenario-710922255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:37:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05842022c6fe4a02b2a5d4ff1bae8825',uuid=8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Converting VIF {"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:dc:33,bridge_name='br-int',has_traffic_filtering=True,id=e7e6b658-d441-4491-90dc-91a5ab29d006,network=Network(0252b2da-ee01-41bf-8462-d421013510b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e6b658-d4') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG os_vif [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:dc:33,bridge_name='br-int',has_traffic_filtering=True,id=e7e6b658-d441-4491-90dc-91a5ab29d006,network=Network(0252b2da-ee01-41bf-8462-d421013510b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e6b658-d4') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ce215d9-6b52-57ad-b358-4e0c3cabd91f', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7e6b658-d4, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7e6b658-d4, col_values=(('qos', UUID('df9ba7c5-f3a4-4d53-9d92-58a3d63ec2fe')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7e6b658-d4, col_values=(('external_ids', {'iface-id': 'e7e6b658-d441-4491-90dc-91a5ab29d006', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:dc:33', 'vm-uuid': '8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:36 user nova-compute[74638]: INFO os_vif [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:dc:33,bridge_name='br-int',has_traffic_filtering=True,id=e7e6b658-d441-4491-90dc-91a5ab29d006,network=Network(0252b2da-ee01-41bf-8462-d421013510b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e6b658-d4')
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No VIF found with MAC fa:16:3e:57:dc:33, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.neutron [req-6958a2ee-69ae-4e30-99ae-2d3695fee2b8 req-26746f9d-2ade-4ff5-94da-41fc0517939c service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updated VIF entry in instance network info cache for port e7e6b658-d441-4491-90dc-91a5ab29d006. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG nova.network.neutron [req-6958a2ee-69ae-4e30-99ae-2d3695fee2b8 req-26746f9d-2ade-4ff5-94da-41fc0517939c service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updating instance_info_cache with network_info: [{"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:37:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6958a2ee-69ae-4e30-99ae-2d3695fee2b8 req-26746f9d-2ade-4ff5-94da-41fc0517939c service nova] Releasing lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:37:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG nova.compute.manager [req-89ebe481-878d-4d0c-9f36-283361ac989e req-ae8222df-0527-4109-b7eb-fbe1351c4b85 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received event network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-89ebe481-878d-4d0c-9f36-283361ac989e req-ae8222df-0527-4109-b7eb-fbe1351c4b85 service nova] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-89ebe481-878d-4d0c-9f36-283361ac989e req-ae8222df-0527-4109-b7eb-fbe1351c4b85 service nova] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-89ebe481-878d-4d0c-9f36-283361ac989e req-ae8222df-0527-4109-b7eb-fbe1351c4b85 service nova] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG nova.compute.manager [req-89ebe481-878d-4d0c-9f36-283361ac989e req-ae8222df-0527-4109-b7eb-fbe1351c4b85 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] No waiting events found dispatching network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:37:38 user nova-compute[74638]: WARNING nova.compute.manager [req-89ebe481-878d-4d0c-9f36-283361ac989e req-ae8222df-0527-4109-b7eb-fbe1351c4b85 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received unexpected event network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 for instance with vm_state building and task_state spawning.
Nov 08 20:37:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:37:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Instance spawned successfully.
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.compute.manager [req-64a5df87-9e91-4ea4-87e3-0b5115c04241 req-5b0d4681-868a-4818-aa3c-035bb43d3096 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received event network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64a5df87-9e91-4ea4-87e3-0b5115c04241 req-5b0d4681-868a-4818-aa3c-035bb43d3096 service nova] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64a5df87-9e91-4ea4-87e3-0b5115c04241 req-5b0d4681-868a-4818-aa3c-035bb43d3096 service nova] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64a5df87-9e91-4ea4-87e3-0b5115c04241 req-5b0d4681-868a-4818-aa3c-035bb43d3096 service nova] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.compute.manager [req-64a5df87-9e91-4ea4-87e3-0b5115c04241 req-5b0d4681-868a-4818-aa3c-035bb43d3096 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] No waiting events found dispatching network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:37:40 user nova-compute[74638]: WARNING nova.compute.manager [req-64a5df87-9e91-4ea4-87e3-0b5115c04241 req-5b0d4681-868a-4818-aa3c-035bb43d3096 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received unexpected event network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 for instance with vm_state building and task_state spawning.
Nov 08 20:37:40 user nova-compute[74638]: INFO nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 08 20:37:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:37:40 user nova-compute[74638]: INFO nova.compute.manager [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Took 7.33 seconds to build instance.
Nov 08 20:37:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-59ee8df1-e6b4-40c8-8940-cc938b267435 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.504s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:37:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:37:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsBTaDut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:38:05 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:38:05 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:38:05 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6ac345-af28-4bf6-bf46-c99fd72fc8bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:38:05 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b51fb2-2386-4488-94b6-fc9d04d0b6de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f] added
Nov 08 20:38:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62c7f2-4e46-4e9e-8123-88573c6cd106]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1fade1-77b9-4c22-9fad-e4154879045c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JsBTaDut {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JsBTaDut" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eab751c-9257-4d4c-a642-a7b4d357e4b5]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JsBTaDut'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[af522d11-8b23-4102-ac12-aa984f217c1e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f93dc8-c166-4c57-9129-4d18e4ed3ad4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6588dc8-64a0-4dfa-84f2-bf0648487069]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f, portal: 172.16.0.220,3260]
Nov 08 20:38:06 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f, portal: 172.16.0.220,3260] successful.
Nov 08 20:38:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffecb1d0-d76e-4761-b9f4-292d20e0cb7a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3b0d2d-2577-40bd-ac08-9fe5cdb2db22]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:06 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:06 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[049f818f-05f3-47ca-9146-cf79a4e7cc4e]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsBTaDut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:06 user nova-compute[74638]: INFO nova.compute.manager [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attaching volume 5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb to /dev/vdb
Nov 08 20:38:07 user nova-compute[74638]: DEBUG os_brick.utils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8325a0e7-5335-40b5-b0c6-5fcd4e1bafd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee503a-8f39-4bb3-bf32-ff9d2f8985ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac6c012-f0a9-453c-9e78-ce90f66e932e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad2d618-63c8-4ea2-be46-e431514bfd47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26239623663313266', 'path': '/dev/sde'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239623663313266', 'path': '/dev/sde'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG nova.objects.instance [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:38:07 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[217735a6-42a0-4001-9321-862c389ff1f2]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG os_brick.utils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating existing volume attachment record: ea444d40-fe8b-4c2f-88e8-c2e04e415daa {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:38:07 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:38:07 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:38:07 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:38:07 user nova-compute[74638]:   <serial>4681c825-1c73-47eb-9dac-0bc4861e7b7f</serial>
Nov 08 20:38:07 user nova-compute[74638]: </disk>
Nov 08 20:38:07 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No VIF found with MAC fa:16:3e:cb:22:8d, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:38:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-17b281fb-a9e6-4f48-be2d-d3a1ab5c20a9 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.589s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d4906c0d-9b90-481d-ae25-a00a75c1f586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:38:11 user nova-compute[74638]: INFO nova.compute.claims [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Claim successful on node user
Nov 08 20:38:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:38:11 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:38:11 user nova-compute[74638]: DEBUG nova.policy [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55df27e8271941e8ac7825d6999ce486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349308d9cb9419f9981a9d28ea61248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:38:12 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Creating image(s)
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "/opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "/opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.186s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk 1073741824" returned: 0 in 0.060s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Successfully created port: 7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Cannot resize image /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Ensure instance console log exists: /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Successfully updated port: 7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquired lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9ebb438-525f-4c9e-957e-3b657263641d req-2876828e-7bce-4a4a-9e94-0ffc6829cf53 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received event network-changed-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-d9ebb438-525f-4c9e-957e-3b657263641d req-2876828e-7bce-4a4a-9e94-0ffc6829cf53 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Refreshing instance network info cache due to event network-changed-7369c1f3-054f-47d5-8cb6-6edddab83dd4. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9ebb438-525f-4c9e-957e-3b657263641d req-2876828e-7bce-4a4a-9e94-0ffc6829cf53 service nova] Acquiring lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:13 user nova-compute[74638]: INFO nova.compute.manager [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Terminating instance
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Updating instance_info_cache with network_info: [{"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Releasing lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Instance network_info: |[{"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9ebb438-525f-4c9e-957e-3b657263641d req-2876828e-7bce-4a4a-9e94-0ffc6829cf53 service nova] Acquired lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-d9ebb438-525f-4c9e-957e-3b657263641d req-2876828e-7bce-4a4a-9e94-0ffc6829cf53 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Refreshing network info cache for port 7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Start _get_guest_xml network_info=[{"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:38:13 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:38:13 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1330233952',display_name='tempest-AttachVolumeNegativeTest-server-1330233952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1330233952',id=42,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOpHoppQf7iXLgfK0Hfx1yjms55+gHIYppBBLUPG6fNSNafch1cMtKBg4RKyki2X4dhsQSi2LVhfnJxe/vzsg6ukV/uwRg+eEGaXfZmQjsDyEx9dJCJGcmJTbVVEbt8AA==',key_name='tempest-keypair-1736110962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-fwi4df48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=d4906c0d-9b90-481d-ae25-a00a75c1f586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:67:3a,bridge_name='br-int',has_traffic_filtering=True,id=7369c1f3-054f-47d5-8cb6-6edddab83dd4,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7369c1f3-05') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.objects.instance [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'pci_devices' on Instance uuid d4906c0d-9b90-481d-ae25-a00a75c1f586 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-ed40e802-3da9-4e68-973e-a0951b83913f req-891bf078-0bd7-40a1-bb40-623f163c85f8 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ed40e802-3da9-4e68-973e-a0951b83913f req-891bf078-0bd7-40a1-bb40-623f163c85f8 service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ed40e802-3da9-4e68-973e-a0951b83913f req-891bf078-0bd7-40a1-bb40-623f163c85f8 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ed40e802-3da9-4e68-973e-a0951b83913f req-891bf078-0bd7-40a1-bb40-623f163c85f8 service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-ed40e802-3da9-4e68-973e-a0951b83913f req-891bf078-0bd7-40a1-bb40-623f163c85f8 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-ed40e802-3da9-4e68-973e-a0951b83913f req-891bf078-0bd7-40a1-bb40-623f163c85f8 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-unplugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:38:13 user nova-compute[74638]:   <uuid>d4906c0d-9b90-481d-ae25-a00a75c1f586</uuid>
Nov 08 20:38:13 user nova-compute[74638]:   <name>instance-0000002a</name>
Nov 08 20:38:13 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:38:13 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:38:13 user nova-compute[74638]:   <metadata>
Nov 08 20:38:13 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:38:13 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:38:13 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1330233952</nova:name>
Nov 08 20:38:13 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:38:13</nova:creationTime>
Nov 08 20:38:13 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:38:13 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:38:13 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:38:13 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:38:13 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:38:13 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:38:13 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:38:13 user nova-compute[74638]:       <nova:owner>
Nov 08 20:38:13 user nova-compute[74638]:         <nova:user uuid="55df27e8271941e8ac7825d6999ce486">tempest-AttachVolumeNegativeTest-1913966386-project-member</nova:user>
Nov 08 20:38:13 user nova-compute[74638]:         <nova:project uuid="a349308d9cb9419f9981a9d28ea61248">tempest-AttachVolumeNegativeTest-1913966386</nova:project>
Nov 08 20:38:13 user nova-compute[74638]:       </nova:owner>
Nov 08 20:38:13 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:38:13 user nova-compute[74638]:       <nova:ports>
Nov 08 20:38:13 user nova-compute[74638]:         <nova:port uuid="7369c1f3-054f-47d5-8cb6-6edddab83dd4">
Nov 08 20:38:13 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 20:38:13 user nova-compute[74638]:         </nova:port>
Nov 08 20:38:13 user nova-compute[74638]:       </nova:ports>
Nov 08 20:38:13 user nova-compute[74638]:     </nova:instance>
Nov 08 20:38:13 user nova-compute[74638]:   </metadata>
Nov 08 20:38:13 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:38:13 user nova-compute[74638]:     <system>
Nov 08 20:38:13 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:38:13 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:38:13 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:38:13 user nova-compute[74638]:       <entry name="serial">d4906c0d-9b90-481d-ae25-a00a75c1f586</entry>
Nov 08 20:38:13 user nova-compute[74638]:       <entry name="uuid">d4906c0d-9b90-481d-ae25-a00a75c1f586</entry>
Nov 08 20:38:13 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:38:13 user nova-compute[74638]:     </system>
Nov 08 20:38:13 user nova-compute[74638]:   </sysinfo>
Nov 08 20:38:13 user nova-compute[74638]:   <os>
Nov 08 20:38:13 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:38:13 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:38:13 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:38:13 user nova-compute[74638]:   </os>
Nov 08 20:38:13 user nova-compute[74638]:   <features>
Nov 08 20:38:13 user nova-compute[74638]:     <acpi/>
Nov 08 20:38:13 user nova-compute[74638]:     <apic/>
Nov 08 20:38:13 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:38:13 user nova-compute[74638]:   </features>
Nov 08 20:38:13 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:38:13 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:38:13 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:38:13 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:38:13 user nova-compute[74638]:   </clock>
Nov 08 20:38:13 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:38:13 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:38:13 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:38:13 user nova-compute[74638]:   </cpu>
Nov 08 20:38:13 user nova-compute[74638]:   <devices>
Nov 08 20:38:13 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:38:13 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:38:13 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk"/>
Nov 08 20:38:13 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:38:13 user nova-compute[74638]:     </disk>
Nov 08 20:38:13 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:38:13 user nova-compute[74638]:       <mac address="fa:16:3e:26:67:3a"/>
Nov 08 20:38:13 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:38:13 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:38:13 user nova-compute[74638]:       <target dev="tap7369c1f3-05"/>
Nov 08 20:38:13 user nova-compute[74638]:     </interface>
Nov 08 20:38:13 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:38:13 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/console.log" append="off"/>
Nov 08 20:38:13 user nova-compute[74638]:     </serial>
Nov 08 20:38:13 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:38:13 user nova-compute[74638]:     <video>
Nov 08 20:38:13 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:38:13 user nova-compute[74638]:     </video>
Nov 08 20:38:13 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:38:13 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:38:13 user nova-compute[74638]:     </rng>
Nov 08 20:38:13 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:38:13 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:38:13 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:38:13 user nova-compute[74638]:     </memballoon>
Nov 08 20:38:13 user nova-compute[74638]:   </devices>
Nov 08 20:38:13 user nova-compute[74638]: </domain>
Nov 08 20:38:13 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1330233952',display_name='tempest-AttachVolumeNegativeTest-server-1330233952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1330233952',id=42,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOpHoppQf7iXLgfK0Hfx1yjms55+gHIYppBBLUPG6fNSNafch1cMtKBg4RKyki2X4dhsQSi2LVhfnJxe/vzsg6ukV/uwRg+eEGaXfZmQjsDyEx9dJCJGcmJTbVVEbt8AA==',key_name='tempest-keypair-1736110962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-fwi4df48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=d4906c0d-9b90-481d-ae25-a00a75c1f586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:67:3a,bridge_name='br-int',has_traffic_filtering=True,id=7369c1f3-054f-47d5-8cb6-6edddab83dd4,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7369c1f3-05') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG os_vif [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:67:3a,bridge_name='br-int',has_traffic_filtering=True,id=7369c1f3-054f-47d5-8cb6-6edddab83dd4,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7369c1f3-05') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '686b51dc-f9cc-510a-aab1-ce68e78b196e', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7369c1f3-05, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7369c1f3-05, col_values=(('qos', UUID('709701e1-10e0-4031-a2b1-d132b63f9b28')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7369c1f3-05, col_values=(('external_ids', {'iface-id': '7369c1f3-054f-47d5-8cb6-6edddab83dd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:67:3a', 'vm-uuid': 'd4906c0d-9b90-481d-ae25-a00a75c1f586'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:13 user nova-compute[74638]: INFO os_vif [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:67:3a,bridge_name='br-int',has_traffic_filtering=True,id=7369c1f3-054f-47d5-8cb6-6edddab83dd4,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7369c1f3-05')
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:38:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No VIF found with MAC fa:16:3e:26:67:3a, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-d9ebb438-525f-4c9e-957e-3b657263641d req-2876828e-7bce-4a4a-9e94-0ffc6829cf53 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Updated VIF entry in instance network info cache for port 7369c1f3-054f-47d5-8cb6-6edddab83dd4. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-d9ebb438-525f-4c9e-957e-3b657263641d req-2876828e-7bce-4a4a-9e94-0ffc6829cf53 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Updating instance_info_cache with network_info: [{"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d9ebb438-525f-4c9e-957e-3b657263641d req-2876828e-7bce-4a4a-9e94-0ffc6829cf53 service nova] Releasing lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Instance destroyed successfully.
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.objects.instance [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'resources' on Instance uuid 685b6be0-e0d5-4af0-bdbc-699b96f5eef8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-977664027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-977664027',id=37,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:34:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-rpbixtgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:36:27Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=685b6be0-e0d5-4af0-bdbc-699b96f5eef8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "d6116299-160a-41e6-87ee-94c985529c3f", "address": "fa:16:3e:43:c0:92", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6116299-16", "ovs_interfaceid": "d6116299-160a-41e6-87ee-94c985529c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:c0:92,bridge_name='br-int',has_traffic_filtering=True,id=d6116299-160a-41e6-87ee-94c985529c3f,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6116299-16') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_vif [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:c0:92,bridge_name='br-int',has_traffic_filtering=True,id=d6116299-160a-41e6-87ee-94c985529c3f,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6116299-16') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6116299-16, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=052671da-0c14-411c-92d2-41c8a641ef04) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:14 user nova-compute[74638]: INFO os_vif [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:c0:92,bridge_name='br-int',has_traffic_filtering=True,id=d6116299-160a-41e6-87ee-94c985529c3f,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6116299-16')
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIxiCOTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:38:14 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff3a90e-026d-4d69-a70a-0ef162278f9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:38:14 user nova-compute[74638]: No targets found.
Nov 08 20:38:14 user nova-compute[74638]: iSNS:
Nov 08 20:38:14 user nova-compute[74638]: No targets found.
Nov 08 20:38:14 user nova-compute[74638]: STATIC:
Nov 08 20:38:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21
Nov 08 20:38:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:38:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:38:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557
Nov 08 20:38:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:38:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:38:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:38:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:38:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:38:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f
Nov 08 20:38:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:38:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:38:14 user nova-compute[74638]: FIRMWARE:
Nov 08 20:38:14 user nova-compute[74638]: No targets found.
Nov 08 20:38:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:38:14 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:38:14 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5217de-1bbe-4709-a989-007e56c21d24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aa6044-193d-4cef-9d25-7ce9ade34e20]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:14 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:38:14 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:14 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:14 user nova-compute[74638]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 (non-flash)
Nov 08 20:38:14 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:14 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c35cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b33423-4502-4a9b-95f0-f0bbf16d0e2d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[465f04e1-88ff-4da3-9cb4-39105175d36b]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c7e14-86b1-4b7d-86c5-9e500daabc1b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf0dac-a2af-4b34-a2f1-12a62d6ba1e4]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc847d-e060-48f5-a374-6038499e043a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a72602-a125-4836-96cf-78ca840aaa58]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557, portal: 172.16.0.220,3260]
Nov 08 20:38:14 user nova-compute[74638]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557, portal: 172.16.0.220,3260] successful.
Nov 08 20:38:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2acc1d1e-821b-43eb-8311-507adb61c557 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84127e3-9264-4cd2-a51b-a7e805e55b20]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] <== disconnect_volume: return (372ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:38:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Deleting instance files /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8_del
Nov 08 20:38:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Deletion of /opt/stack/data/nova/instances/685b6be0-e0d5-4af0-bdbc-699b96f5eef8_del complete
Nov 08 20:38:14 user nova-compute[74638]: INFO nova.compute.manager [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 08 20:38:14 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:38:14 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:38:15 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Took 0.46 seconds to deallocate network for instance.
Nov 08 20:38:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-804ea718-76c0-44fb-a846-e7c2d6beb205 req-7c7cf015-7d8e-455b-94b5-500e7f8cf714 service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-deleted-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ef9851e-e6ab-45c1-8da1-058cd402f4af req-9852aba3-1956-4529-9617-290a0f9b2f6d service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ef9851e-e6ab-45c1-8da1-058cd402f4af req-9852aba3-1956-4529-9617-290a0f9b2f6d service nova] Acquiring lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ef9851e-e6ab-45c1-8da1-058cd402f4af req-9852aba3-1956-4529-9617-290a0f9b2f6d service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3ef9851e-e6ab-45c1-8da1-058cd402f4af req-9852aba3-1956-4529-9617-290a0f9b2f6d service nova] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-3ef9851e-e6ab-45c1-8da1-058cd402f4af req-9852aba3-1956-4529-9617-290a0f9b2f6d service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] No waiting events found dispatching network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:38:15 user nova-compute[74638]: WARNING nova.compute.manager [req-3ef9851e-e6ab-45c1-8da1-058cd402f4af req-9852aba3-1956-4529-9617-290a0f9b2f6d service nova] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Received unexpected event network-vif-plugged-d6116299-160a-41e6-87ee-94c985529c3f for instance with vm_state active and task_state deleting.
Nov 08 20:38:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-2bb23072-a468-4d12-b298-ca238606248f req-d6fcf8a3-221f-4f86-b770-d7f4dd97f159 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received event network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2bb23072-a468-4d12-b298-ca238606248f req-d6fcf8a3-221f-4f86-b770-d7f4dd97f159 service nova] Acquiring lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2bb23072-a468-4d12-b298-ca238606248f req-d6fcf8a3-221f-4f86-b770-d7f4dd97f159 service nova] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2bb23072-a468-4d12-b298-ca238606248f req-d6fcf8a3-221f-4f86-b770-d7f4dd97f159 service nova] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-2bb23072-a468-4d12-b298-ca238606248f req-d6fcf8a3-221f-4f86-b770-d7f4dd97f159 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] No waiting events found dispatching network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:38:15 user nova-compute[74638]: WARNING nova.compute.manager [req-2bb23072-a468-4d12-b298-ca238606248f req-d6fcf8a3-221f-4f86-b770-d7f4dd97f159 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received unexpected event network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 for instance with vm_state building and task_state spawning.
Nov 08 20:38:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:16 user nova-compute[74638]: INFO nova.compute.manager [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 685b6be0-e0d5-4af0-bdbc-699b96f5eef8] Took 1.08 seconds to detach 1 volumes for instance.
Nov 08 20:38:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:16 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:38:16 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:38:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:16 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Deleted allocations for instance 685b6be0-e0d5-4af0-bdbc-699b96f5eef8
Nov 08 20:38:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-157ed17b-3747-4c9d-ad39-dd4af8a2d7c0 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "685b6be0-e0d5-4af0-bdbc-699b96f5eef8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.728s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:38:17 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Instance spawned successfully.
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:38:17 user nova-compute[74638]: INFO nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:38:17 user nova-compute[74638]: INFO nova.compute.manager [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Took 6.41 seconds to build instance.
Nov 08 20:38:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e203c79d-2e43-4135-8299-d7335971b621 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.537s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-97cc951f-d1ee-4982-8ca7-332a08f94686 req-4eaf2ee0-ed89-4311-a545-d8b1f78b1dee service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received event network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97cc951f-d1ee-4982-8ca7-332a08f94686 req-4eaf2ee0-ed89-4311-a545-d8b1f78b1dee service nova] Acquiring lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97cc951f-d1ee-4982-8ca7-332a08f94686 req-4eaf2ee0-ed89-4311-a545-d8b1f78b1dee service nova] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97cc951f-d1ee-4982-8ca7-332a08f94686 req-4eaf2ee0-ed89-4311-a545-d8b1f78b1dee service nova] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-97cc951f-d1ee-4982-8ca7-332a08f94686 req-4eaf2ee0-ed89-4311-a545-d8b1f78b1dee service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] No waiting events found dispatching network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:38:17 user nova-compute[74638]: WARNING nova.compute.manager [req-97cc951f-d1ee-4982-8ca7-332a08f94686 req-4eaf2ee0-ed89-4311-a545-d8b1f78b1dee service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received unexpected event network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 for instance with vm_state active and task_state None.
Nov 08 20:38:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:38:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:38:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:38:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:38:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:38:20 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid 9c01852a-a4a9-48d9-a6f2-c74a31643837 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updating instance_info_cache with network_info: [{"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-9c01852a-a4a9-48d9-a6f2-c74a31643837" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:21 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:38:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:25 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:38:25 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8116MB free_disk=24.81448745727539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d4906c0d-9b90-481d-ae25-a00a75c1f586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:38:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:27 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:38:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnKyGIxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:38:31 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:38:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:38:31 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:38:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:38:31 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b145bd-3793-4f83-88be-6b02ab5362b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:38:31 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f998e1-a7f4-49e2-9c69-d66853f9a6e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb] added
Nov 08 20:38:31 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[872fa340-2f71-418d-943e-959fcde9b86d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c88108-39ba-45e7-bb69-e8fe3b17ea2f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnKyGIxH {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnKyGIxH" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5e4498-240c-425f-8978-cb403573d358]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AnKyGIxH'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f919738-65e7-4faf-80f2-602ed43223e3]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[90839ac2-0bd6-4026-9410-ebab5c728e60]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:32 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:32 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa0229-d859-4169-b3e1-1946c4ac159d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb, portal: 172.16.0.220,3260]
Nov 08 20:38:32 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb, portal: 172.16.0.220,3260] successful.
Nov 08 20:38:32 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2e8c12-9fdd-426b-a8b3-9f5d5f41b2f2]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd463f8a-0188-4973-bc20-9275c59d5deb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb (non-flash)
Nov 08 20:38:32 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:32 user nova-compute[74638]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb (non-flash)
Nov 08 20:38:32 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bafd357-6077-405f-b541-6a7f73e84781]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:32 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnKyGIxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26366663730643432', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366663730643432', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:38:33 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:38:33 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:38:33 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:38:33 user nova-compute[74638]:   <serial>5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb</serial>
Nov 08 20:38:33 user nova-compute[74638]: </disk>
Nov 08 20:38:33 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] No VIF found with MAC fa:16:3e:46:07:49, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:38:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef5daca5-4849-4d63-9107-b5451af4b59b tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.821s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:35 user nova-compute[74638]: INFO nova.compute.manager [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Detaching volume 5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb
Nov 08 20:38:35 user nova-compute[74638]: INFO nova.virt.block_device [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Attempting to driver detach volume 5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb from mountpoint /dev/vdb
Nov 08 20:38:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Attempting to detach device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:38:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:38:35 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:38:35 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:38:35 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:38:35 user nova-compute[74638]:   <serial>5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb</serial>
Nov 08 20:38:35 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:38:35 user nova-compute[74638]: </disk>
Nov 08 20:38:35 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:38:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully detached device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the persistent domain config.
Nov 08 20:38:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:38:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:38:35 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:38:35 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:38:35 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:38:35 user nova-compute[74638]:   <serial>5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb</serial>
Nov 08 20:38:35 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:38:35 user nova-compute[74638]: </disk>
Nov 08 20:38:35 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:38:36 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:38:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:38:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:38:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:38:40 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:38:40 user nova-compute[74638]: INFO nova.compute.claims [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Claim successful on node user
Nov 08 20:38:41 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:38:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:38:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:38:41 user nova-compute[74638]: INFO nova.virt.block_device [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Booting with volume e34c52c5-83eb-40e5-aa3d-922ab93a9310 at /dev/vda
Nov 08 20:38:41 user nova-compute[74638]: DEBUG nova.policy [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63d3b55213f44fbb4dd76758a9a61ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e599a20be834415ea60230b8743a2338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG os_brick.utils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8d4cbe-0c1f-4c56-9268-15ec8668b94a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[678ffbd4-e2fc-4852-bcfb-2e32ab7485db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ad2171-9b50-4ba8-a8f6-1af3d17a43f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bef879-7f7d-4313-b3de-c45c95855bae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:38:41 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:38:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c12ac2-abe2-4648-949b-316e23dc4587]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG os_brick.utils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:38:41 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updating existing volume attachment record: bc513e44-fd38-4ef5-8c41-61f178f6c27d {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:38:42 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Successfully created port: d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Successfully updated port: d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquired lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-9006be0f-eee0-4fe8-a6e6-17848c1eed0d req-c15cc27b-19f4-4dd6-a6c7-99e1a5904616 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received event network-changed-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.compute.manager [req-9006be0f-eee0-4fe8-a6e6-17848c1eed0d req-c15cc27b-19f4-4dd6-a6c7-99e1a5904616 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Refreshing instance network info cache due to event network-changed-d8f08084-31a6-4192-8e38-4b5e66d497a6. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9006be0f-eee0-4fe8-a6e6-17848c1eed0d req-c15cc27b-19f4-4dd6-a6c7-99e1a5904616 service nova] Acquiring lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updating instance_info_cache with network_info: [{"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Releasing lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Instance network_info: |[{"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9006be0f-eee0-4fe8-a6e6-17848c1eed0d req-c15cc27b-19f4-4dd6-a6c7-99e1a5904616 service nova] Acquired lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-9006be0f-eee0-4fe8-a6e6-17848c1eed0d req-c15cc27b-19f4-4dd6-a6c7-99e1a5904616 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Refreshing network info cache for port d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-9006be0f-eee0-4fe8-a6e6-17848c1eed0d req-c15cc27b-19f4-4dd6-a6c7-99e1a5904616 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updated VIF entry in instance network info cache for port d8f08084-31a6-4192-8e38-4b5e66d497a6. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG nova.network.neutron [req-9006be0f-eee0-4fe8-a6e6-17848c1eed0d req-c15cc27b-19f4-4dd6-a6c7-99e1a5904616 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updating instance_info_cache with network_info: [{"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:38:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9006be0f-eee0-4fe8-a6e6-17848c1eed0d req-c15cc27b-19f4-4dd6-a6c7-99e1a5904616 service nova] Releasing lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:38:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:38:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:38:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:38:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:38:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:56 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b409323-6dcf-4395-92ec-1d79b27c515b is timed out.
Nov 08 20:38:56 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully detached device vdb from instance 0b409323-6dcf-4395-92ec-1d79b27c515b from the live domain config.
Nov 08 20:38:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnKyGIxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:38:56 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aae95a1-5f79-453a-852c-2febb778c4fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:38:56 user nova-compute[74638]: No targets found.
Nov 08 20:38:56 user nova-compute[74638]: iSNS:
Nov 08 20:38:56 user nova-compute[74638]: No targets found.
Nov 08 20:38:56 user nova-compute[74638]: STATIC:
Nov 08 20:38:56 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21
Nov 08 20:38:56 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:38:56 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:38:56 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:38:56 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:38:56 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:38:56 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb
Nov 08 20:38:56 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:38:56 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:38:56 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f
Nov 08 20:38:56 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:38:56 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:38:56 user nova-compute[74638]: FIRMWARE:
Nov 08 20:38:56 user nova-compute[74638]: No targets found.
Nov 08 20:38:56 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:38:56 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:38:56 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0653616e-18b9-4b23-89be-c1c37a89f354]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e761b5d-a4ff-4db2-9d64-075372340ecf]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:56 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:56 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:56 user nova-compute[74638]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb (non-flash)
Nov 08 20:38:56 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:38:56 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:38:56 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:38:56 user nova-compute[74638]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb (non-flash)
Nov 08 20:38:56 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c71cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f689f8-0c7e-4ef6-9120-5e6960c54758]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e64b3-78a3-4438-9322-2ef547855c5b]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5dc9a8-0068-45da-a264-db8585c7d6e4]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4457647d-2dc9-4c1d-96cb-d4219c558772]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd7e75b-bafe-4aba-89f0-d0691c8a5b79]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc83da5f-fd62-46b7-ab9e-182753dcb101]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb, portal: 172.16.0.220,3260]
Nov 08 20:38:56 user nova-compute[74638]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb, portal: 172.16.0.220,3260] successful.
Nov 08 20:38:56 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce5dac6-9347-4f02-9ca5-1a7adc29fdfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a335d097-5527-4ff8-9b17-a4721fefc5f6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] <== disconnect_volume: return (304ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:38:56 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:38:57 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'flavor' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:38:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f97fc148-4a40-4e72-882f-757244c907de tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.006s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:38:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:38:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:38:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:38:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:38:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:38:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:04 user nova-compute[74638]: INFO nova.compute.manager [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Terminating instance
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-535d0855-756e-4166-92d5-1e4e5093197b req-dc6dcef8-f08a-407f-90f8-91034386e09a service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received event network-vif-unplugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-535d0855-756e-4166-92d5-1e4e5093197b req-dc6dcef8-f08a-407f-90f8-91034386e09a service nova] Acquiring lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-535d0855-756e-4166-92d5-1e4e5093197b req-dc6dcef8-f08a-407f-90f8-91034386e09a service nova] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-535d0855-756e-4166-92d5-1e4e5093197b req-dc6dcef8-f08a-407f-90f8-91034386e09a service nova] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-535d0855-756e-4166-92d5-1e4e5093197b req-dc6dcef8-f08a-407f-90f8-91034386e09a service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] No waiting events found dispatching network-vif-unplugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-535d0855-756e-4166-92d5-1e4e5093197b req-dc6dcef8-f08a-407f-90f8-91034386e09a service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received event network-vif-unplugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Instance destroyed successfully.
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'resources' on Instance uuid 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:28:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1285470780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1285470780',id=33,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-tfqrmb0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:30:48Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=3f30e649-f2c0-4b9d-8446-329b1ea7dc9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "address": "fa:16:3e:b7:b6:94", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3613fe-a2", "ovs_interfaceid": "5a3613fe-a2ba-4acf-826c-fe11b3bc79c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b6:94,bridge_name='br-int',has_traffic_filtering=True,id=5a3613fe-a2ba-4acf-826c-fe11b3bc79c3,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3613fe-a2') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG os_vif [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b6:94,bridge_name='br-int',has_traffic_filtering=True,id=5a3613fe-a2ba-4acf-826c-fe11b3bc79c3,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3613fe-a2') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a3613fe-a2, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4731b347-26f6-4ceb-91a2-92b3ba75717f) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:04 user nova-compute[74638]: INFO os_vif [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b6:94,bridge_name='br-int',has_traffic_filtering=True,id=5a3613fe-a2ba-4acf-826c-fe11b3bc79c3,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3613fe-a2')
Nov 08 20:39:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Deleting instance files /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d_del
Nov 08 20:39:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Deletion of /opt/stack/data/nova/instances/3f30e649-f2c0-4b9d-8446-329b1ea7dc9d_del complete
Nov 08 20:39:04 user nova-compute[74638]: INFO nova.compute.manager [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:39:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Creating image(s)
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Ensure instance console log exists: /opt/stack/data/nova/instances/f228ded5-9ae6-45eb-b81c-e67b294201a4/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Start _get_guest_xml network_info=[{"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'bc513e44-fd38-4ef5-8c41-61f178f6c27d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDrnFigY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f228ded5-9ae6-45eb-b81c-e67b294201a4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e34c52c5-83eb-40e5-aa3d-922ab93a9310', 'serial': 'e34c52c5-83eb-40e5-aa3d-922ab93a9310'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:39:04 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:39:04 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:39:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDrnFigY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:39:05 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:39:05 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:39:05 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f83a32-cc68-44fd-868e-0925b6ef0639]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:39:05 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b9eba-2b14-4e17-829f-5bdc55180afe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310] added
Nov 08 20:39:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6631e68e-8010-43ff-9ab3-543827d36389]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74cd2e1-bc3a-4694-a58b-04f71e61f4ac]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDrnFigY {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDrnFigY" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ab7f17-d8a1-4cbb-99d8-4f68f42da6b0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BDrnFigY'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ea3e38-a1f3-405a-a33e-bde6491e4d3c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94d75a-f580-451f-a6c8-76394247ad74]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b78e6b-1738-4363-bf74-79d9e11f2387]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310, portal: 172.16.0.220,3260]
Nov 08 20:39:05 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310, portal: 172.16.0.220,3260] successful.
Nov 08 20:39:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ccf40c-7524-406b-a453-62ca6b958800]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8444bc61-d38b-4c58-87c6-d165a47a153c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:05 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4066dc-bca2-45ae-98f7-4b1cee768dcb]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDrnFigY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:39:05 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Took 0.48 seconds to deallocate network for instance.
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:05 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Deleted allocations for instance 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d
Nov 08 20:39:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5a532552-a9e5-462b-86c3-d44768780b57 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.835s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26535316239396464', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535316239396464', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1491425149',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1491425149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1491425149',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRJvFY0nAWFZHpvInv/qhc/9i8r4K8jkeHcUXJvvu6bVu3KDLeb8myrCgL+e04M+zauBw0Z9V1SEVyMK2/hSjgwpPD2Hk0ALiirD7DAOw9e0cOnAkWstsixCHMsdrQHVA==',key_name='tempest-keypair-1125324791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-efjun1c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:38:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=f228ded5-9ae6-45eb-b81c-e67b294201a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:31:96,bridge_name='br-int',has_traffic_filtering=True,id=d8f08084-31a6-4192-8e38-4b5e66d497a6,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f08084-31') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'pci_devices' on Instance uuid f228ded5-9ae6-45eb-b81c-e67b294201a4 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:39:06 user nova-compute[74638]:   <uuid>f228ded5-9ae6-45eb-b81c-e67b294201a4</uuid>
Nov 08 20:39:06 user nova-compute[74638]:   <name>instance-0000002b</name>
Nov 08 20:39:06 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:39:06 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:39:06 user nova-compute[74638]:   <metadata>
Nov 08 20:39:06 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:39:06 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:39:06 user nova-compute[74638]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1491425149</nova:name>
Nov 08 20:39:06 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:39:04</nova:creationTime>
Nov 08 20:39:06 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:39:06 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:39:06 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:39:06 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:39:06 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:39:06 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:39:06 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:39:06 user nova-compute[74638]:       <nova:owner>
Nov 08 20:39:06 user nova-compute[74638]:         <nova:user uuid="f63d3b55213f44fbb4dd76758a9a61ed">tempest-TestVolumeBootPattern-1116596406-project-member</nova:user>
Nov 08 20:39:06 user nova-compute[74638]:         <nova:project uuid="e599a20be834415ea60230b8743a2338">tempest-TestVolumeBootPattern-1116596406</nova:project>
Nov 08 20:39:06 user nova-compute[74638]:       </nova:owner>
Nov 08 20:39:06 user nova-compute[74638]:       <nova:ports>
Nov 08 20:39:06 user nova-compute[74638]:         <nova:port uuid="d8f08084-31a6-4192-8e38-4b5e66d497a6">
Nov 08 20:39:06 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 20:39:06 user nova-compute[74638]:         </nova:port>
Nov 08 20:39:06 user nova-compute[74638]:       </nova:ports>
Nov 08 20:39:06 user nova-compute[74638]:     </nova:instance>
Nov 08 20:39:06 user nova-compute[74638]:   </metadata>
Nov 08 20:39:06 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:39:06 user nova-compute[74638]:     <system>
Nov 08 20:39:06 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:39:06 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:39:06 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:39:06 user nova-compute[74638]:       <entry name="serial">f228ded5-9ae6-45eb-b81c-e67b294201a4</entry>
Nov 08 20:39:06 user nova-compute[74638]:       <entry name="uuid">f228ded5-9ae6-45eb-b81c-e67b294201a4</entry>
Nov 08 20:39:06 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:39:06 user nova-compute[74638]:     </system>
Nov 08 20:39:06 user nova-compute[74638]:   </sysinfo>
Nov 08 20:39:06 user nova-compute[74638]:   <os>
Nov 08 20:39:06 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:39:06 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:39:06 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:39:06 user nova-compute[74638]:   </os>
Nov 08 20:39:06 user nova-compute[74638]:   <features>
Nov 08 20:39:06 user nova-compute[74638]:     <acpi/>
Nov 08 20:39:06 user nova-compute[74638]:     <apic/>
Nov 08 20:39:06 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:39:06 user nova-compute[74638]:   </features>
Nov 08 20:39:06 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:39:06 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:39:06 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:39:06 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:39:06 user nova-compute[74638]:   </clock>
Nov 08 20:39:06 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:39:06 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:39:06 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:39:06 user nova-compute[74638]:   </cpu>
Nov 08 20:39:06 user nova-compute[74638]:   <devices>
Nov 08 20:39:06 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:39:06 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:39:06 user nova-compute[74638]:       <source dev="/dev/sdd"/>
Nov 08 20:39:06 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:39:06 user nova-compute[74638]:       <serial>e34c52c5-83eb-40e5-aa3d-922ab93a9310</serial>
Nov 08 20:39:06 user nova-compute[74638]:     </disk>
Nov 08 20:39:06 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:39:06 user nova-compute[74638]:       <mac address="fa:16:3e:54:31:96"/>
Nov 08 20:39:06 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:39:06 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:39:06 user nova-compute[74638]:       <target dev="tapd8f08084-31"/>
Nov 08 20:39:06 user nova-compute[74638]:     </interface>
Nov 08 20:39:06 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:39:06 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/f228ded5-9ae6-45eb-b81c-e67b294201a4/console.log" append="off"/>
Nov 08 20:39:06 user nova-compute[74638]:     </serial>
Nov 08 20:39:06 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:39:06 user nova-compute[74638]:     <video>
Nov 08 20:39:06 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:39:06 user nova-compute[74638]:     </video>
Nov 08 20:39:06 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:39:06 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:39:06 user nova-compute[74638]:     </rng>
Nov 08 20:39:06 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:39:06 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:39:06 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:39:06 user nova-compute[74638]:     </memballoon>
Nov 08 20:39:06 user nova-compute[74638]:   </devices>
Nov 08 20:39:06 user nova-compute[74638]: </domain>
Nov 08 20:39:06 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1491425149',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1491425149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1491425149',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRJvFY0nAWFZHpvInv/qhc/9i8r4K8jkeHcUXJvvu6bVu3KDLeb8myrCgL+e04M+zauBw0Z9V1SEVyMK2/hSjgwpPD2Hk0ALiirD7DAOw9e0cOnAkWstsixCHMsdrQHVA==',key_name='tempest-keypair-1125324791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-efjun1c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:38:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=f228ded5-9ae6-45eb-b81c-e67b294201a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:31:96,bridge_name='br-int',has_traffic_filtering=True,id=d8f08084-31a6-4192-8e38-4b5e66d497a6,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f08084-31') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG os_vif [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:31:96,bridge_name='br-int',has_traffic_filtering=True,id=d8f08084-31a6-4192-8e38-4b5e66d497a6,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f08084-31') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '107697c5-f040-5858-a0f2-1a78e7f0e56e', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8f08084-31, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8f08084-31, col_values=(('qos', UUID('3192211f-db22-42dc-a89c-f941040c3bcc')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8f08084-31, col_values=(('external_ids', {'iface-id': 'd8f08084-31a6-4192-8e38-4b5e66d497a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:31:96', 'vm-uuid': 'f228ded5-9ae6-45eb-b81c-e67b294201a4'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-b5e7d8ef-f281-4d1b-a742-4b67f00acbf0 req-7faf7d1c-44b1-4a62-9fb6-abe06e972424 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received event network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b5e7d8ef-f281-4d1b-a742-4b67f00acbf0 req-7faf7d1c-44b1-4a62-9fb6-abe06e972424 service nova] Acquiring lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b5e7d8ef-f281-4d1b-a742-4b67f00acbf0 req-7faf7d1c-44b1-4a62-9fb6-abe06e972424 service nova] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b5e7d8ef-f281-4d1b-a742-4b67f00acbf0 req-7faf7d1c-44b1-4a62-9fb6-abe06e972424 service nova] Lock "3f30e649-f2c0-4b9d-8446-329b1ea7dc9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-b5e7d8ef-f281-4d1b-a742-4b67f00acbf0 req-7faf7d1c-44b1-4a62-9fb6-abe06e972424 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] No waiting events found dispatching network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:39:06 user nova-compute[74638]: WARNING nova.compute.manager [req-b5e7d8ef-f281-4d1b-a742-4b67f00acbf0 req-7faf7d1c-44b1-4a62-9fb6-abe06e972424 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received unexpected event network-vif-plugged-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 for instance with vm_state deleted and task_state None.
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-b5e7d8ef-f281-4d1b-a742-4b67f00acbf0 req-7faf7d1c-44b1-4a62-9fb6-abe06e972424 service nova] [instance: 3f30e649-f2c0-4b9d-8446-329b1ea7dc9d] Received event network-vif-deleted-5a3613fe-a2ba-4acf-826c-fe11b3bc79c3 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:06 user nova-compute[74638]: INFO os_vif [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:31:96,bridge_name='br-int',has_traffic_filtering=True,id=d8f08084-31a6-4192-8e38-4b5e66d497a6,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f08084-31')
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:39:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No VIF found with MAC fa:16:3e:54:31:96, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:39:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-44c84363-4be3-4150-80dd-90b98c20c1db req-bd918935-5675-4d0d-938f-21066361f691 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received event network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-44c84363-4be3-4150-80dd-90b98c20c1db req-bd918935-5675-4d0d-938f-21066361f691 service nova] Acquiring lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-44c84363-4be3-4150-80dd-90b98c20c1db req-bd918935-5675-4d0d-938f-21066361f691 service nova] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-44c84363-4be3-4150-80dd-90b98c20c1db req-bd918935-5675-4d0d-938f-21066361f691 service nova] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-44c84363-4be3-4150-80dd-90b98c20c1db req-bd918935-5675-4d0d-938f-21066361f691 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] No waiting events found dispatching network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:39:07 user nova-compute[74638]: WARNING nova.compute.manager [req-44c84363-4be3-4150-80dd-90b98c20c1db req-bd918935-5675-4d0d-938f-21066361f691 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received unexpected event network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 for instance with vm_state building and task_state spawning.
Nov 08 20:39:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:39:09 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Instance spawned successfully.
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:39:09 user nova-compute[74638]: INFO nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-7322c3d5-29c9-47ce-a735-ad4aebadbf3a req-c741bdc0-c5f4-4c8b-a72a-0be632d718bb service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received event network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7322c3d5-29c9-47ce-a735-ad4aebadbf3a req-c741bdc0-c5f4-4c8b-a72a-0be632d718bb service nova] Acquiring lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7322c3d5-29c9-47ce-a735-ad4aebadbf3a req-c741bdc0-c5f4-4c8b-a72a-0be632d718bb service nova] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7322c3d5-29c9-47ce-a735-ad4aebadbf3a req-c741bdc0-c5f4-4c8b-a72a-0be632d718bb service nova] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-7322c3d5-29c9-47ce-a735-ad4aebadbf3a req-c741bdc0-c5f4-4c8b-a72a-0be632d718bb service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] No waiting events found dispatching network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:39:09 user nova-compute[74638]: WARNING nova.compute.manager [req-7322c3d5-29c9-47ce-a735-ad4aebadbf3a req-c741bdc0-c5f4-4c8b-a72a-0be632d718bb service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received unexpected event network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 for instance with vm_state building and task_state spawning.
Nov 08 20:39:09 user nova-compute[74638]: INFO nova.compute.manager [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Took 29.30 seconds to build instance.
Nov 08 20:39:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9e0379e6-11cd-4592-91a9-304b25d6fd2e tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.411s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-e1d4b350-c7e8-460a-bf5b-fde82b2d7afe req-94004bad-09f3-4d6f-a1c6-75e2ddb64f17 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-e1d4b350-c7e8-460a-bf5b-fde82b2d7afe req-94004bad-09f3-4d6f-a1c6-75e2ddb64f17 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing instance network info cache due to event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:39:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e1d4b350-c7e8-460a-bf5b-fde82b2d7afe req-94004bad-09f3-4d6f-a1c6-75e2ddb64f17 service nova] Acquiring lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:39:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e1d4b350-c7e8-460a-bf5b-fde82b2d7afe req-94004bad-09f3-4d6f-a1c6-75e2ddb64f17 service nova] Acquired lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:39:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-e1d4b350-c7e8-460a-bf5b-fde82b2d7afe req-94004bad-09f3-4d6f-a1c6-75e2ddb64f17 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-e1d4b350-c7e8-460a-bf5b-fde82b2d7afe req-94004bad-09f3-4d6f-a1c6-75e2ddb64f17 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updated VIF entry in instance network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-e1d4b350-c7e8-460a-bf5b-fde82b2d7afe req-94004bad-09f3-4d6f-a1c6-75e2ddb64f17 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e1d4b350-c7e8-460a-bf5b-fde82b2d7afe req-94004bad-09f3-4d6f-a1c6-75e2ddb64f17 service nova] Releasing lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG nova.compute.manager [req-496f70a4-ff87-4d35-a063-b616627eef1f req-083ddf98-66a2-422d-9666-fe0842347520 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG nova.compute.manager [req-496f70a4-ff87-4d35-a063-b616627eef1f req-083ddf98-66a2-422d-9666-fe0842347520 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing instance network info cache due to event network-changed-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-496f70a4-ff87-4d35-a063-b616627eef1f req-083ddf98-66a2-422d-9666-fe0842347520 service nova] Acquiring lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-496f70a4-ff87-4d35-a063-b616627eef1f req-083ddf98-66a2-422d-9666-fe0842347520 service nova] Acquired lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG nova.network.neutron [req-496f70a4-ff87-4d35-a063-b616627eef1f req-083ddf98-66a2-422d-9666-fe0842347520 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Refreshing network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:14 user nova-compute[74638]: INFO nova.compute.manager [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Detaching volume 5b65c059-6740-4162-beaa-f01ed1944d21
Nov 08 20:39:15 user nova-compute[74638]: INFO nova.virt.block_device [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Attempting to driver detach volume 5b65c059-6740-4162-beaa-f01ed1944d21 from mountpoint /dev/vdb
Nov 08 20:39:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Attempting to detach device vdb from instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:39:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:39:15 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:39:15 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:39:15 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:39:15 user nova-compute[74638]:   <serial>5b65c059-6740-4162-beaa-f01ed1944d21</serial>
Nov 08 20:39:15 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 20:39:15 user nova-compute[74638]: </disk>
Nov 08 20:39:15 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:39:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully detached device vdb from instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 from the persistent domain config.
Nov 08 20:39:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:39:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:39:15 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:39:15 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:39:15 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:39:15 user nova-compute[74638]:   <serial>5b65c059-6740-4162-beaa-f01ed1944d21</serial>
Nov 08 20:39:15 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 20:39:15 user nova-compute[74638]: </disk>
Nov 08 20:39:15 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:39:15 user nova-compute[74638]: DEBUG nova.network.neutron [req-496f70a4-ff87-4d35-a063-b616627eef1f req-083ddf98-66a2-422d-9666-fe0842347520 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updated VIF entry in instance network info cache for port 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:39:15 user nova-compute[74638]: DEBUG nova.network.neutron [req-496f70a4-ff87-4d35-a063-b616627eef1f req-083ddf98-66a2-422d-9666-fe0842347520 service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [{"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:39:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-496f70a4-ff87-4d35-a063-b616627eef1f req-083ddf98-66a2-422d-9666-fe0842347520 service nova] Releasing lock "refresh_cache-d6a4f12a-a033-461a-82c0-157b2be2dcd8" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:39:15 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:39:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:19 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:39:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:39:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:39:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:39:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:39:20 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating instance_info_cache with network_info: [{"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:39:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-560f5d57-098f-49ce-b9be-cf5f3c091bb7" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:39:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:39:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:39:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:39:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:39:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:39:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:22 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:23 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:39:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8d40b81-c6d1-4ce9-939d-d39968002928 req-77198f87-36c5-4dda-8d45-a45b3bf0c7ba service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received event network-changed-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8d40b81-c6d1-4ce9-939d-d39968002928 req-77198f87-36c5-4dda-8d45-a45b3bf0c7ba service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Refreshing instance network info cache due to event network-changed-e7e6b658-d441-4491-90dc-91a5ab29d006. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8d40b81-c6d1-4ce9-939d-d39968002928 req-77198f87-36c5-4dda-8d45-a45b3bf0c7ba service nova] Acquiring lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8d40b81-c6d1-4ce9-939d-d39968002928 req-77198f87-36c5-4dda-8d45-a45b3bf0c7ba service nova] Acquired lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-f8d40b81-c6d1-4ce9-939d-d39968002928 req-77198f87-36c5-4dda-8d45-a45b3bf0c7ba service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Refreshing network info cache for port e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-f8d40b81-c6d1-4ce9-939d-d39968002928 req-77198f87-36c5-4dda-8d45-a45b3bf0c7ba service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updated VIF entry in instance network info cache for port e7e6b658-d441-4491-90dc-91a5ab29d006. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG nova.network.neutron [req-f8d40b81-c6d1-4ce9-939d-d39968002928 req-77198f87-36c5-4dda-8d45-a45b3bf0c7ba service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updating instance_info_cache with network_info: [{"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8d40b81-c6d1-4ce9-939d-d39968002928 req-77198f87-36c5-4dda-8d45-a45b3bf0c7ba service nova] Releasing lock "refresh_cache-8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lazy-loading 'flavor' on Instance uuid 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:24 user nova-compute[74638]: INFO nova.compute.manager [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Attaching volume 397498e9-bdb5-46ed-941e-2b7e00ff06e6 to /dev/vdb
Nov 08 20:39:24 user nova-compute[74638]: DEBUG os_brick.utils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:39:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f6556-cbc3-49fa-899c-3d41251a2953]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e442472-0a34-4189-aad4-85c173570ef5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a371444-cdf2-4a13-a0b8-ffc33cdabbe3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee6fab2-524c-492e-b401-ac949a066767]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:39:25 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[176ea348-8490-4f24-acd0-d564d85313b9]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG os_brick.utils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updating existing volume attachment record: dd84bac3-c209-40dc-a192-432f70cc75c7 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:26 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:39:26 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8006MB free_disk=24.909339904785156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d4906c0d-9b90-481d-ae25-a00a75c1f586 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f228ded5-9ae6-45eb-b81c-e67b294201a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:39:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:39:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:35 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 is timed out.
Nov 08 20:39:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully detached device vdb from instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 from the live domain config.
Nov 08 20:39:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKbVGzmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:39:35 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a73f3-c858-4e7d-af8f-1d719354a9ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:39:35 user nova-compute[74638]: No targets found.
Nov 08 20:39:35 user nova-compute[74638]: iSNS:
Nov 08 20:39:35 user nova-compute[74638]: No targets found.
Nov 08 20:39:35 user nova-compute[74638]: STATIC:
Nov 08 20:39:35 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21
Nov 08 20:39:35 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:39:35 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:39:35 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:39:35 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:39:35 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:39:35 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310
Nov 08 20:39:35 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:39:35 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:39:35 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f
Nov 08 20:39:35 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:39:35 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:39:35 user nova-compute[74638]: FIRMWARE:
Nov 08 20:39:35 user nova-compute[74638]: No targets found.
Nov 08 20:39:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:39:35 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:39:35 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa4a10-0a8a-479a-af7b-40a351e5e13a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[162753d4-ae5f-43a4-9f78-2353c22f7bc1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:35 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:39:35 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:35 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:35 user nova-compute[74638]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 (non-flash)
Nov 08 20:39:35 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:35 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe51c775ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfaa609-e775-455c-86a0-aa3e0f70a21a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ff255f-38fe-4cc9-bb7c-ac0c508ce89f]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09b5a2b-da98-4095-be5c-327f934897a1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f20046-6e3c-46d8-9ace-fc2f3551dd08]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7556ee48-37ee-4b5f-819f-009c94fb08c5]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2daec2-c0e8-4be8-bcc9-557b7ec5f3e2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260]
Nov 08 20:39:35 user nova-compute[74638]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21, portal: 172.16.0.220,3260] successful.
Nov 08 20:39:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b65c059-6740-4162-beaa-f01ed1944d21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[91249293-5dc2-4e46-b242-c04a162d0dca]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] <== disconnect_volume: return (321ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:39:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:39:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:36 user nova-compute[74638]: DEBUG nova.objects.instance [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'flavor' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:39:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b190254c-b158-4eed-8239-954707714763 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amKRJxUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:39:49 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:39:49 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:39:49 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc30e4d-cd0c-4f48-b785-f26b1808ec07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:39:49 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d08224-f837-46b2-8564-d6d2167c86b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6] added
Nov 08 20:39:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4797561-f9b0-4263-ae7c-3e8022afe565]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95c5d2-d241-47b8-8a7b-28f0a9e695a3]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amKRJxUg {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amKRJxUg" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ef44c-695b-400d-bad3-949125a1d3ba]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amKRJxUg'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2dc9b7-67e0-4d86-933e-a1b0222fb6ce]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5807b6cf-c82a-4460-9b75-e876cc0f05ec]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc635f1-31cc-404d-a582-4fde3204f9bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6, portal: 172.16.0.220,3260]
Nov 08 20:39:49 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6, portal: 172.16.0.220,3260] successful.
Nov 08 20:39:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[36070ab5-1dd5-42e1-8180-325b9d88501d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68a9eda-758d-4dbb-a036-935746ba6de3]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:39:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:49 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:39:49 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cba31b9-832a-48b2-b959-fc8b8e78b7e1]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:39:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amKRJxUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:39:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:39:50 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23863383464336666', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:39:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863383464336666', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:39:50 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lazy-loading 'flavor' on Instance uuid 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:39:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:39:50 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:39:50 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:39:50 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:39:50 user nova-compute[74638]:   <serial>397498e9-bdb5-46ed-941e-2b7e00ff06e6</serial>
Nov 08 20:39:50 user nova-compute[74638]: </disk>
Nov 08 20:39:50 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:39:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:39:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:39:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No VIF found with MAC fa:16:3e:57:dc:33, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:39:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9ec23fa0-c500-40e7-b018-8649a41c02ff tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.144s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG nova.objects.instance [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lazy-loading 'flavor' on Instance uuid 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:54 user nova-compute[74638]: INFO nova.compute.manager [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Attaching volume 3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 to /dev/vdc
Nov 08 20:39:54 user nova-compute[74638]: DEBUG os_brick.utils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681615b-ba16-41a0-b2ff-ed8d855dadd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f295cf8-998f-4256-9c47-1f965dbc73b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae907ded-f508-40fc-966e-fc808b837f2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc1690-266b-4352-8754-2cc06ab63721]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:39:54 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[725fd348-1d50-43ec-b5ba-3960f511a178]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG os_brick.utils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updating existing volume attachment record: f15d5a28-549e-436d-9310-3a740ee9920a {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:54 user nova-compute[74638]: INFO nova.compute.manager [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Terminating instance
Nov 08 20:39:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-ef557a27-8504-4500-8bde-acf06022e191 req-6dff7c11-2a95-4b0d-afa9-eec611bd6910 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ef557a27-8504-4500-8bde-acf06022e191 req-6dff7c11-2a95-4b0d-afa9-eec611bd6910 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ef557a27-8504-4500-8bde-acf06022e191 req-6dff7c11-2a95-4b0d-afa9-eec611bd6910 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ef557a27-8504-4500-8bde-acf06022e191 req-6dff7c11-2a95-4b0d-afa9-eec611bd6910 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-ef557a27-8504-4500-8bde-acf06022e191 req-6dff7c11-2a95-4b0d-afa9-eec611bd6910 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-ef557a27-8504-4500-8bde-acf06022e191 req-6dff7c11-2a95-4b0d-afa9-eec611bd6910 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-unplugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:55 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Instance destroyed successfully.
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.objects.instance [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'resources' on Instance uuid 560f5d57-098f-49ce-b9be-cf5f3c091bb7 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1811673025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1811673025',id=28,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-ksxmvhpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:27:03Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=560f5d57-098f-49ce-b9be-cf5f3c091bb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "address": "fa:16:3e:23:44:e8", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad67f50-98", "ovs_interfaceid": "3ad67f50-983b-43e0-ada8-5da7b9d5ef28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3ad67f50-983b-43e0-ada8-5da7b9d5ef28,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad67f50-98') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_vif [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3ad67f50-983b-43e0-ada8-5da7b9d5ef28,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad67f50-98') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ad67f50-98, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adb9725a-f52e-4dd3-bdef-505276403fd3) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:39:55 user nova-compute[74638]: INFO os_vif [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:44:e8,bridge_name='br-int',has_traffic_filtering=True,id=3ad67f50-983b-43e0-ada8-5da7b9d5ef28,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad67f50-98')
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJvkzcIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:39:55 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f709d0-662f-48ec-9306-4c9a97802e4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:39:55 user nova-compute[74638]: No targets found.
Nov 08 20:39:55 user nova-compute[74638]: iSNS:
Nov 08 20:39:55 user nova-compute[74638]: No targets found.
Nov 08 20:39:55 user nova-compute[74638]: STATIC:
Nov 08 20:39:55 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6
Nov 08 20:39:55 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:39:55 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:39:55 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d
Nov 08 20:39:55 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:39:55 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:39:55 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310
Nov 08 20:39:55 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:39:55 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:39:55 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f
Nov 08 20:39:55 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:39:55 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:39:55 user nova-compute[74638]: FIRMWARE:
Nov 08 20:39:55 user nova-compute[74638]: No targets found.
Nov 08 20:39:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:39:55 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:39:55 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[331af128-ec9e-4d7a-b70f-e9a0bbc78ea3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[923d4d67-245c-43d9-a675-4336195676de]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:55 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:55 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:55 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:39:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d (non-flash)
Nov 08 20:39:55 user nova-compute[74638]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:39:55 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:39:55 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:39:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54de5b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f30ae-fec9-494e-8ca6-a36b456a5165]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4689bed5-f4ff-42be-9897-88bbcad72264]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f2776e-60a3-4345-8383-2a4197334732]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c91d80-79c4-409a-b70f-dfe8197ca252]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[47423489-8362-420d-9c32-9e87c714fde9]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33d7211-03b7-4ec9-9b17-206402118716]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d, portal: 172.16.0.220,3260]
Nov 08 20:39:55 user nova-compute[74638]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d, portal: 172.16.0.220,3260] successful.
Nov 08 20:39:55 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec11291-8f97-42b8-9527-d95f5c5ab64d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aaecd8-12c2-4da5-9481-38b5e9d75371]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] <== disconnect_volume: return (357ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:39:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:39:55 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Deleting instance files /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7_del
Nov 08 20:39:55 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Deletion of /opt/stack/data/nova/instances/560f5d57-098f-49ce-b9be-cf5f3c091bb7_del complete
Nov 08 20:39:56 user nova-compute[74638]: INFO nova.compute.manager [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 08 20:39:56 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:39:56 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:39:56 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:39:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:39:56 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:39:56 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Took 0.64 seconds to deallocate network for instance.
Nov 08 20:39:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-405d1b31-2106-445c-af92-6253d0f9ef6d req-b0c9a3cb-291a-4831-9e8b-bb1e3b0abc44 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-deleted-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-1f674ae7-e632-45cc-a1b5-0aab74057e7a req-c95632ac-53a2-4470-afa4-7994b8165431 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:39:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1f674ae7-e632-45cc-a1b5-0aab74057e7a req-c95632ac-53a2-4470-afa4-7994b8165431 service nova] Acquiring lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1f674ae7-e632-45cc-a1b5-0aab74057e7a req-c95632ac-53a2-4470-afa4-7994b8165431 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1f674ae7-e632-45cc-a1b5-0aab74057e7a req-c95632ac-53a2-4470-afa4-7994b8165431 service nova] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-1f674ae7-e632-45cc-a1b5-0aab74057e7a req-c95632ac-53a2-4470-afa4-7994b8165431 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] No waiting events found dispatching network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:39:57 user nova-compute[74638]: WARNING nova.compute.manager [req-1f674ae7-e632-45cc-a1b5-0aab74057e7a req-c95632ac-53a2-4470-afa4-7994b8165431 service nova] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Received unexpected event network-vif-plugged-3ad67f50-983b-43e0-ada8-5da7b9d5ef28 for instance with vm_state active and task_state deleting.
Nov 08 20:39:57 user nova-compute[74638]: INFO nova.compute.manager [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 560f5d57-098f-49ce-b9be-cf5f3c091bb7] Took 1.01 seconds to detach 1 volumes for instance.
Nov 08 20:39:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:39:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:39:58 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:39:58 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:39:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:58 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Deleted allocations for instance 560f5d57-098f-49ce-b9be-cf5f3c091bb7
Nov 08 20:39:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-50e3f9ba-16a5-4add-933d-26e4171ee367 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "560f5d57-098f-49ce-b9be-cf5f3c091bb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.690s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:39:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG nova.compute.manager [req-737c5e8c-83e4-4c0d-8597-043e4a753782 req-cc498c28-f29c-4bc0-a3a1-2aca96ce76ef service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received event network-changed-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG nova.compute.manager [req-737c5e8c-83e4-4c0d-8597-043e4a753782 req-cc498c28-f29c-4bc0-a3a1-2aca96ce76ef service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Refreshing instance network info cache due to event network-changed-7369c1f3-054f-47d5-8cb6-6edddab83dd4. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-737c5e8c-83e4-4c0d-8597-043e4a753782 req-cc498c28-f29c-4bc0-a3a1-2aca96ce76ef service nova] Acquiring lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-737c5e8c-83e4-4c0d-8597-043e4a753782 req-cc498c28-f29c-4bc0-a3a1-2aca96ce76ef service nova] Acquired lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG nova.network.neutron [req-737c5e8c-83e4-4c0d-8597-043e4a753782 req-cc498c28-f29c-4bc0-a3a1-2aca96ce76ef service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Refreshing network info cache for port 7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d4906c0d-9b90-481d-ae25-a00a75c1f586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG nova.network.neutron [req-737c5e8c-83e4-4c0d-8597-043e4a753782 req-cc498c28-f29c-4bc0-a3a1-2aca96ce76ef service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Updated VIF entry in instance network info cache for port 7369c1f3-054f-47d5-8cb6-6edddab83dd4. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG nova.network.neutron [req-737c5e8c-83e4-4c0d-8597-043e4a753782 req-cc498c28-f29c-4bc0-a3a1-2aca96ce76ef service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Updating instance_info_cache with network_info: [{"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:02 user nova-compute[74638]: INFO nova.compute.manager [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Terminating instance
Nov 08 20:40:02 user nova-compute[74638]: DEBUG nova.compute.manager [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-737c5e8c-83e4-4c0d-8597-043e4a753782 req-cc498c28-f29c-4bc0-a3a1-2aca96ce76ef service nova] Releasing lock "refresh_cache-d4906c0d-9b90-481d-ae25-a00a75c1f586" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Instance destroyed successfully.
Nov 08 20:40:03 user nova-compute[74638]: DEBUG nova.objects.instance [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'resources' on Instance uuid d4906c0d-9b90-481d-ae25-a00a75c1f586 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:38:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1330233952',display_name='tempest-AttachVolumeNegativeTest-server-1330233952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1330233952',id=42,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOpHoppQf7iXLgfK0Hfx1yjms55+gHIYppBBLUPG6fNSNafch1cMtKBg4RKyki2X4dhsQSi2LVhfnJxe/vzsg6ukV/uwRg+eEGaXfZmQjsDyEx9dJCJGcmJTbVVEbt8AA==',key_name='tempest-keypair-1736110962',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:38:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-fwi4df48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:38:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=d4906c0d-9b90-481d-ae25-a00a75c1f586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "address": "fa:16:3e:26:67:3a", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7369c1f3-05", "ovs_interfaceid": "7369c1f3-054f-47d5-8cb6-6edddab83dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:67:3a,bridge_name='br-int',has_traffic_filtering=True,id=7369c1f3-054f-47d5-8cb6-6edddab83dd4,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7369c1f3-05') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG os_vif [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:67:3a,bridge_name='br-int',has_traffic_filtering=True,id=7369c1f3-054f-47d5-8cb6-6edddab83dd4,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7369c1f3-05') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7369c1f3-05, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=709701e1-10e0-4031-a2b1-d132b63f9b28) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:03 user nova-compute[74638]: INFO os_vif [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:67:3a,bridge_name='br-int',has_traffic_filtering=True,id=7369c1f3-054f-47d5-8cb6-6edddab83dd4,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7369c1f3-05')
Nov 08 20:40:03 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Deleting instance files /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586_del
Nov 08 20:40:03 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Deletion of /opt/stack/data/nova/instances/d4906c0d-9b90-481d-ae25-a00a75c1f586_del complete
Nov 08 20:40:03 user nova-compute[74638]: INFO nova.compute.manager [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 08 20:40:03 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:40:03 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:04 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Took 0.68 seconds to deallocate network for instance.
Nov 08 20:40:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-1247a130-020a-41c8-b714-5ae8c590794f req-d80717f3-301a-4b73-9a2c-d3904cd9e411 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received event network-vif-deleted-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received event network-vif-unplugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] Acquiring lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] No waiting events found dispatching network-vif-unplugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:40:04 user nova-compute[74638]: WARNING nova.compute.manager [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received unexpected event network-vif-unplugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 for instance with vm_state deleted and task_state None.
Nov 08 20:40:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received event network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] Acquiring lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] No waiting events found dispatching network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:40:04 user nova-compute[74638]: WARNING nova.compute.manager [req-c9177987-3429-42bf-840c-b4de2a2014e6 req-48a73026-566a-4af3-94d4-143920c521f8 service nova] [instance: d4906c0d-9b90-481d-ae25-a00a75c1f586] Received unexpected event network-vif-plugged-7369c1f3-054f-47d5-8cb6-6edddab83dd4 for instance with vm_state deleted and task_state None.
Nov 08 20:40:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:04 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Deleted allocations for instance d4906c0d-9b90-481d-ae25-a00a75c1f586
Nov 08 20:40:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-5df6b76f-7bc0-45c9-8dac-d6c82ad52408 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d4906c0d-9b90-481d-ae25-a00a75c1f586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.983s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:16 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:40:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:19 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:19 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:40:21 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:21 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:40:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:40:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:40:21 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:40:22 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating instance_info_cache with network_info: [{"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-0b409323-6dcf-4395-92ec-1d79b27c515b" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:40:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:40:22 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:23 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:40:24 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:26 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:40:26 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8306MB free_disk=24.926815032958984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 9c01852a-a4a9-48d9-a6f2-c74a31643837 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 0b409323-6dcf-4395-92ec-1d79b27c515b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f228ded5-9ae6-45eb-b81c-e67b294201a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:40:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:40:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:40:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:40:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBCbaOrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:40:29 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:40:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:40:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:40:29 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:40:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:40:29 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:40:29 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:40:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[11edcafc-18a3-4b41-b5dd-1b05c77100b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:40:30 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e396774-3406-45f0-94f8-73a99b11a9b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3] added
Nov 08 20:40:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2509d0-fb3b-4651-b241-47f698598837]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0f23d1-ae0c-46ac-a672-5016081a2c99]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBCbaOrP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBCbaOrP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4476209-17af-4720-bb5d-4b653825e41d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KBCbaOrP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d634c8d7-deae-48ed-981c-b06c6c140719]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89351ec-77c3-4a41-87cc-570b822ed1d0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0346d827-e37a-4a7a-a63e-6b9092fefe4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3, portal: 172.16.0.220,3260]
Nov 08 20:40:30 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3, portal: 172.16.0.220,3260] successful.
Nov 08 20:40:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1b99b4-d349-4f1f-88af-c3fa3ca147b5]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dae1da-9309-4a90-9c6a-2cf8aaa116a2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 (non-flash)
Nov 08 20:40:30 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5dc111-2712-4010-ac8a-d63cfefcb6b1]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:30 user nova-compute[74638]: INFO nova.compute.manager [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Terminating instance
Nov 08 20:40:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:40:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.compute.manager [req-013397dc-c3c0-40d8-94ae-01c2bc73f1b5 req-a0b108d2-139f-4e2d-afbf-0a134b8746dc service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-unplugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-013397dc-c3c0-40d8-94ae-01c2bc73f1b5 req-a0b108d2-139f-4e2d-afbf-0a134b8746dc service nova] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-013397dc-c3c0-40d8-94ae-01c2bc73f1b5 req-a0b108d2-139f-4e2d-afbf-0a134b8746dc service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-013397dc-c3c0-40d8-94ae-01c2bc73f1b5 req-a0b108d2-139f-4e2d-afbf-0a134b8746dc service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.compute.manager [req-013397dc-c3c0-40d8-94ae-01c2bc73f1b5 req-a0b108d2-139f-4e2d-afbf-0a134b8746dc service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] No waiting events found dispatching network-vif-unplugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.compute.manager [req-013397dc-c3c0-40d8-94ae-01c2bc73f1b5 req-a0b108d2-139f-4e2d-afbf-0a134b8746dc service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-unplugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBCbaOrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26531313533363233', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531313533363233', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.objects.instance [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lazy-loading 'flavor' on Instance uuid 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:40:31 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:40:31 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:40:31 user nova-compute[74638]:   <target dev="vdc" bus="virtio"/>
Nov 08 20:40:31 user nova-compute[74638]:   <serial>3fddfbdf-5b29-4fd9-9f34-c58cba042ea3</serial>
Nov 08 20:40:31 user nova-compute[74638]: </disk>
Nov 08 20:40:31 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.compute.manager [req-68ce05ed-726a-4c01-88e1-4666232acb09 req-9b79aa6e-636c-4f26-8ab6-ac89ce5942ae service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received event network-changed-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.compute.manager [req-68ce05ed-726a-4c01-88e1-4666232acb09 req-9b79aa6e-636c-4f26-8ab6-ac89ce5942ae service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Refreshing instance network info cache due to event network-changed-d8f08084-31a6-4192-8e38-4b5e66d497a6. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-68ce05ed-726a-4c01-88e1-4666232acb09 req-9b79aa6e-636c-4f26-8ab6-ac89ce5942ae service nova] Acquiring lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-68ce05ed-726a-4c01-88e1-4666232acb09 req-9b79aa6e-636c-4f26-8ab6-ac89ce5942ae service nova] Acquired lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.network.neutron [req-68ce05ed-726a-4c01-88e1-4666232acb09 req-9b79aa6e-636c-4f26-8ab6-ac89ce5942ae service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Refreshing network info cache for port d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:40:31 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Instance destroyed successfully.
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'resources' on Instance uuid d6a4f12a-a033-461a-82c0-157b2be2dcd8 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:34:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1325662292',display_name='tempest-TestMinimumBasicScenario-server-1325662292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1325662292',id=38,image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCPi1E0igEFZIdJhZePk4DFeVJRb0sGuZNECAaBx8cK2GZaERHs7lvKuVpUC4dqiBhtTTuoqxTWClMijGvMvsL9sYx84lTEJSNMJFUnoSzDfmc6zIJbGw39SqU9mhTrQ==',key_name='tempest-TestMinimumBasicScenario-551223592',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:34:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-btomml66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ae1b1a07-db61-49ca-b03a-0c7257589e84',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:37:30Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=d6a4f12a-a033-461a-82c0-157b2be2dcd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "address": "fa:16:3e:42:24:ed", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f99d813-1d", "ovs_interfaceid": "6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:40:31 user nova-compute[74638]: DEBUG os_vif [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f99d813-1d, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f1d59ae-8b3e-4dd2-9964-a088f33e39c9) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:32 user nova-compute[74638]: INFO os_vif [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:24:ed,bridge_name='br-int',has_traffic_filtering=True,id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f99d813-1d')
Nov 08 20:40:32 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Deleting instance files /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8_del
Nov 08 20:40:32 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Deletion of /opt/stack/data/nova/instances/d6a4f12a-a033-461a-82c0-157b2be2dcd8_del complete
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] No VIF found with MAC fa:16:3e:57:dc:33, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:40:32 user nova-compute[74638]: INFO nova.compute.manager [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 08 20:40:32 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-62248df7-c325-4022-8ba3-e1bedc7fd17f tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.904s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:32 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Took 0.56 seconds to deallocate network for instance.
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-aea15cba-87aa-4d36-87a6-7c3014f0e949 req-69c61345-e267-4d84-a0ce-d30d27dfd1ec service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-deleted-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:32 user nova-compute[74638]: INFO nova.compute.manager [req-aea15cba-87aa-4d36-87a6-7c3014f0e949 req-69c61345-e267-4d84-a0ce-d30d27dfd1ec service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Neutron deleted interface 6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a; detaching it from the instance and deleting it from the info cache
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.network.neutron [req-aea15cba-87aa-4d36-87a6-7c3014f0e949 req-69c61345-e267-4d84-a0ce-d30d27dfd1ec service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-aea15cba-87aa-4d36-87a6-7c3014f0e949 req-69c61345-e267-4d84-a0ce-d30d27dfd1ec service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Detach interface failed, port_id=6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a, reason: Instance d6a4f12a-a033-461a-82c0-157b2be2dcd8 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.network.neutron [req-68ce05ed-726a-4c01-88e1-4666232acb09 req-9b79aa6e-636c-4f26-8ab6-ac89ce5942ae service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updated VIF entry in instance network info cache for port d8f08084-31a6-4192-8e38-4b5e66d497a6. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.network.neutron [req-68ce05ed-726a-4c01-88e1-4666232acb09 req-9b79aa6e-636c-4f26-8ab6-ac89ce5942ae service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updating instance_info_cache with network_info: [{"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-68ce05ed-726a-4c01-88e1-4666232acb09 req-9b79aa6e-636c-4f26-8ab6-ac89ce5942ae service nova] Releasing lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:40:32 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:33 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Deleted allocations for instance d6a4f12a-a033-461a-82c0-157b2be2dcd8
Nov 08 20:40:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2970e84c-8357-4058-9bde-92a7fe005b7b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.243s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:33 user nova-compute[74638]: INFO nova.compute.manager [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Detaching volume 3fddfbdf-5b29-4fd9-9f34-c58cba042ea3
Nov 08 20:40:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-6d90c3bf-91d0-4274-9923-dce3be56fadd req-1bd79e4f-8499-4b11-8961-d929a00bf09e service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6d90c3bf-91d0-4274-9923-dce3be56fadd req-1bd79e4f-8499-4b11-8961-d929a00bf09e service nova] Acquiring lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6d90c3bf-91d0-4274-9923-dce3be56fadd req-1bd79e4f-8499-4b11-8961-d929a00bf09e service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6d90c3bf-91d0-4274-9923-dce3be56fadd req-1bd79e4f-8499-4b11-8961-d929a00bf09e service nova] Lock "d6a4f12a-a033-461a-82c0-157b2be2dcd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG nova.compute.manager [req-6d90c3bf-91d0-4274-9923-dce3be56fadd req-1bd79e4f-8499-4b11-8961-d929a00bf09e service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] No waiting events found dispatching network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:40:33 user nova-compute[74638]: WARNING nova.compute.manager [req-6d90c3bf-91d0-4274-9923-dce3be56fadd req-1bd79e4f-8499-4b11-8961-d929a00bf09e service nova] [instance: d6a4f12a-a033-461a-82c0-157b2be2dcd8] Received unexpected event network-vif-plugged-6f99d813-1d6c-42b9-b0dc-b4ccd8698e7a for instance with vm_state deleted and task_state None.
Nov 08 20:40:33 user nova-compute[74638]: INFO nova.virt.block_device [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Attempting to driver detach volume 3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 from mountpoint /dev/vdc
Nov 08 20:40:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Attempting to detach device vdc from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:40:33 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:40:33 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:40:33 user nova-compute[74638]:   <target dev="vdc" bus="virtio"/>
Nov 08 20:40:33 user nova-compute[74638]:   <serial>3fddfbdf-5b29-4fd9-9f34-c58cba042ea3</serial>
Nov 08 20:40:33 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 20:40:33 user nova-compute[74638]: </disk>
Nov 08 20:40:33 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:40:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Successfully detached device vdc from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d from the persistent domain config.
Nov 08 20:40:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:40:33 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:40:33 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:40:33 user nova-compute[74638]:   <target dev="vdc" bus="virtio"/>
Nov 08 20:40:33 user nova-compute[74638]:   <serial>3fddfbdf-5b29-4fd9-9f34-c58cba042ea3</serial>
Nov 08 20:40:33 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 20:40:33 user nova-compute[74638]: </disk>
Nov 08 20:40:33 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:40:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:40:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:45 user nova-compute[74638]: INFO nova.compute.manager [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Terminating instance
Nov 08 20:40:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-bddd46a0-4d3c-4f61-b4f9-52f0f05968f4 req-9230da0c-a0d0-41b3-954d-6494fd8c3650 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received event network-vif-unplugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bddd46a0-4d3c-4f61-b4f9-52f0f05968f4 req-9230da0c-a0d0-41b3-954d-6494fd8c3650 service nova] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bddd46a0-4d3c-4f61-b4f9-52f0f05968f4 req-9230da0c-a0d0-41b3-954d-6494fd8c3650 service nova] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bddd46a0-4d3c-4f61-b4f9-52f0f05968f4 req-9230da0c-a0d0-41b3-954d-6494fd8c3650 service nova] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-bddd46a0-4d3c-4f61-b4f9-52f0f05968f4 req-9230da0c-a0d0-41b3-954d-6494fd8c3650 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] No waiting events found dispatching network-vif-unplugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-bddd46a0-4d3c-4f61-b4f9-52f0f05968f4 req-9230da0c-a0d0-41b3-954d-6494fd8c3650 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received event network-vif-unplugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:40:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Instance destroyed successfully.
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lazy-loading 'resources' on Instance uuid 9c01852a-a4a9-48d9-a6f2-c74a31643837 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2037527489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2037527489',id=25,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d69c08c247c41cd842c3673cf9af390',ramdisk_id='',reservation_id='r-wso06n86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:22:14Z,user_data=None,user_id='9ab02946569c47ff9772753454afc5b3',uuid=9c01852a-a4a9-48d9-a6f2-c74a31643837,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converting VIF {"id": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "address": "fa:16:3e:bc:14:3f", "network": {"id": "27dae222-87b6-4620-9e79-7bec6bd7c241", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1697440449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d69c08c247c41cd842c3673cf9af390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap979e34e9-2f", "ovs_interfaceid": "979e34e9-2f00-4e0f-8228-c4f39ac78755", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:14:3f,bridge_name='br-int',has_traffic_filtering=True,id=979e34e9-2f00-4e0f-8228-c4f39ac78755,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap979e34e9-2f') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG os_vif [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:14:3f,bridge_name='br-int',has_traffic_filtering=True,id=979e34e9-2f00-4e0f-8228-c4f39ac78755,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap979e34e9-2f') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap979e34e9-2f, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c24224f3-170e-4ab2-b3a7-e2e685b91ce8) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:40:46 user nova-compute[74638]: INFO os_vif [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:14:3f,bridge_name='br-int',has_traffic_filtering=True,id=979e34e9-2f00-4e0f-8228-c4f39ac78755,network=Network(27dae222-87b6-4620-9e79-7bec6bd7c241),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap979e34e9-2f')
Nov 08 20:40:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Deleting instance files /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837_del
Nov 08 20:40:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Deletion of /opt/stack/data/nova/instances/9c01852a-a4a9-48d9-a6f2-c74a31643837_del complete
Nov 08 20:40:46 user nova-compute[74638]: INFO nova.compute.manager [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 08 20:40:46 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:40:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:40:47 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:47 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Took 0.91 seconds to deallocate network for instance.
Nov 08 20:40:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-e2efd13f-3986-49e2-be62-9d08d24178e2 req-a1d79176-ede1-4689-a7c0-eddfd319c19d service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received event network-vif-deleted-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:47 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:40:47 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:40:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:47 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Deleted allocations for instance 9c01852a-a4a9-48d9-a6f2-c74a31643837
Nov 08 20:40:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-53157177-4036-4325-a306-e3f728489234 tempest-ServerBootFromVolumeStableRescueTest-1821986023 tempest-ServerBootFromVolumeStableRescueTest-1821986023-project-member] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.015s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-083793c6-2cd8-46d3-a4ce-9ca2985bc25c req-7d7ce394-9a6f-4e92-95c8-5e729ab81c59 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received event network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-083793c6-2cd8-46d3-a4ce-9ca2985bc25c req-7d7ce394-9a6f-4e92-95c8-5e729ab81c59 service nova] Acquiring lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-083793c6-2cd8-46d3-a4ce-9ca2985bc25c req-7d7ce394-9a6f-4e92-95c8-5e729ab81c59 service nova] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-083793c6-2cd8-46d3-a4ce-9ca2985bc25c req-7d7ce394-9a6f-4e92-95c8-5e729ab81c59 service nova] Lock "9c01852a-a4a9-48d9-a6f2-c74a31643837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-083793c6-2cd8-46d3-a4ce-9ca2985bc25c req-7d7ce394-9a6f-4e92-95c8-5e729ab81c59 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] No waiting events found dispatching network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:40:48 user nova-compute[74638]: WARNING nova.compute.manager [req-083793c6-2cd8-46d3-a4ce-9ca2985bc25c req-7d7ce394-9a6f-4e92-95c8-5e729ab81c59 service nova] [instance: 9c01852a-a4a9-48d9-a6f2-c74a31643837] Received unexpected event network-vif-plugged-979e34e9-2f00-4e0f-8228-c4f39ac78755 for instance with vm_state deleted and task_state None.
Nov 08 20:40:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:40:48 user nova-compute[74638]: INFO nova.compute.claims [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Claim successful on node user
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:40:48 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.network.neutron [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:40:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:40:49 user nova-compute[74638]: INFO nova.virt.block_device [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Booting with volume snapshot dfb46b82-1634-4162-9564-dbb7034026b7 at /dev/vda
Nov 08 20:40:49 user nova-compute[74638]: DEBUG nova.policy [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63d3b55213f44fbb4dd76758a9a61ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e599a20be834415ea60230b8743a2338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:49 user nova-compute[74638]: INFO nova.compute.manager [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Terminating instance
Nov 08 20:40:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-7091c004-76df-4cb3-bfac-1dc21f7e832d req-700d1c93-84c8-4e46-83ad-667f77c2fb58 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received event network-vif-unplugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7091c004-76df-4cb3-bfac-1dc21f7e832d req-700d1c93-84c8-4e46-83ad-667f77c2fb58 service nova] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7091c004-76df-4cb3-bfac-1dc21f7e832d req-700d1c93-84c8-4e46-83ad-667f77c2fb58 service nova] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7091c004-76df-4cb3-bfac-1dc21f7e832d req-700d1c93-84c8-4e46-83ad-667f77c2fb58 service nova] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-7091c004-76df-4cb3-bfac-1dc21f7e832d req-700d1c93-84c8-4e46-83ad-667f77c2fb58 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] No waiting events found dispatching network-vif-unplugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-7091c004-76df-4cb3-bfac-1dc21f7e832d req-700d1c93-84c8-4e46-83ad-667f77c2fb58 service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received event network-vif-unplugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:49 user nova-compute[74638]: DEBUG nova.network.neutron [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Successfully created port: d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:40:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Instance destroyed successfully.
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lazy-loading 'resources' on Instance uuid 0b409323-6dcf-4395-92ec-1d79b27c515b {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1898793169',display_name='tempest-SnapshotDataIntegrityTests-server-1898793169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1898793169',id=35,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGJ4OMVO9CjnqzXjXxTo8JSRgGMBrbgNN8FS8y903Mofdc6Hc3+uhHmeoefq+WcPCxIpGQatPncNMMutoq5wnsuzShqk0LMvVX/SQVf1zfmNwKDH1SCYIk/uW4qy42OIQ==',key_name='tempest-keypair-245506309',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77b84dfb76a24be7b4f05798c33f7804',ramdisk_id='',reservation_id='r-9bo263bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-511643886',owner_user_name='tempest-SnapshotDataIntegrityTests-511643886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:30:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f691961292564fffa7e77b384264c583',uuid=0b409323-6dcf-4395-92ec-1d79b27c515b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Converting VIF {"id": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "address": "fa:16:3e:46:07:49", "network": {"id": "e3d53a81-7dda-44fe-85a5-1c9d7c9509f9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1632549041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77b84dfb76a24be7b4f05798c33f7804", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f3e6fde-c6", "ovs_interfaceid": "4f3e6fde-c683-4e62-ac4c-92810970fbfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:07:49,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6fde-c683-4e62-ac4c-92810970fbfb,network=Network(e3d53a81-7dda-44fe-85a5-1c9d7c9509f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6fde-c6') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG os_vif [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:07:49,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6fde-c683-4e62-ac4c-92810970fbfb,network=Network(e3d53a81-7dda-44fe-85a5-1c9d7c9509f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6fde-c6') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f3e6fde-c6, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ee830bf-0a7d-42e2-af83-ab7c72a54e96) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:50 user nova-compute[74638]: INFO os_vif [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:07:49,bridge_name='br-int',has_traffic_filtering=True,id=4f3e6fde-c683-4e62-ac4c-92810970fbfb,network=Network(e3d53a81-7dda-44fe-85a5-1c9d7c9509f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f3e6fde-c6')
Nov 08 20:40:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Deleting instance files /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b_del
Nov 08 20:40:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Deletion of /opt/stack/data/nova/instances/0b409323-6dcf-4395-92ec-1d79b27c515b_del complete
Nov 08 20:40:50 user nova-compute[74638]: INFO nova.compute.manager [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 08 20:40:50 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Successfully updated port: d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquired lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:50 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Took 0.75 seconds to deallocate network for instance.
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b99c8b20-1266-441a-a77c-7e9a61241dac req-a5dd0d5a-4f9a-4aa2-b9f5-547b15da2465 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Received event network-changed-d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.compute.manager [req-b99c8b20-1266-441a-a77c-7e9a61241dac req-a5dd0d5a-4f9a-4aa2-b9f5-547b15da2465 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Refreshing instance network info cache due to event network-changed-d0e61db5-52dd-402f-b745-332941c01194. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b99c8b20-1266-441a-a77c-7e9a61241dac req-a5dd0d5a-4f9a-4aa2-b9f5-547b15da2465 service nova] Acquiring lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Updating instance_info_cache with network_info: [{"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Releasing lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Instance network_info: |[{"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b99c8b20-1266-441a-a77c-7e9a61241dac req-a5dd0d5a-4f9a-4aa2-b9f5-547b15da2465 service nova] Acquired lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.network.neutron [req-b99c8b20-1266-441a-a77c-7e9a61241dac req-a5dd0d5a-4f9a-4aa2-b9f5-547b15da2465 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Refreshing network info cache for port d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:40:51 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Deleted allocations for instance 0b409323-6dcf-4395-92ec-1d79b27c515b
Nov 08 20:40:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ad3169a1-a73b-4376-b19f-ca0e0b197971 tempest-SnapshotDataIntegrityTests-511643886 tempest-SnapshotDataIntegrityTests-511643886-project-member] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-5b176755-873e-4ebd-aedd-96f6c181fba5 req-2e4aba4c-b1c3-4540-a32b-eb8a3163c33b service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received event network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5b176755-873e-4ebd-aedd-96f6c181fba5 req-2e4aba4c-b1c3-4540-a32b-eb8a3163c33b service nova] Acquiring lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5b176755-873e-4ebd-aedd-96f6c181fba5 req-2e4aba4c-b1c3-4540-a32b-eb8a3163c33b service nova] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5b176755-873e-4ebd-aedd-96f6c181fba5 req-2e4aba4c-b1c3-4540-a32b-eb8a3163c33b service nova] Lock "0b409323-6dcf-4395-92ec-1d79b27c515b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-5b176755-873e-4ebd-aedd-96f6c181fba5 req-2e4aba4c-b1c3-4540-a32b-eb8a3163c33b service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] No waiting events found dispatching network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:40:51 user nova-compute[74638]: WARNING nova.compute.manager [req-5b176755-873e-4ebd-aedd-96f6c181fba5 req-2e4aba4c-b1c3-4540-a32b-eb8a3163c33b service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received unexpected event network-vif-plugged-4f3e6fde-c683-4e62-ac4c-92810970fbfb for instance with vm_state deleted and task_state None.
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-5b176755-873e-4ebd-aedd-96f6c181fba5 req-2e4aba4c-b1c3-4540-a32b-eb8a3163c33b service nova] [instance: 0b409323-6dcf-4395-92ec-1d79b27c515b] Received event network-vif-deleted-4f3e6fde-c683-4e62-ac4c-92810970fbfb {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.network.neutron [req-b99c8b20-1266-441a-a77c-7e9a61241dac req-a5dd0d5a-4f9a-4aa2-b9f5-547b15da2465 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Updated VIF entry in instance network info cache for port d0e61db5-52dd-402f-b745-332941c01194. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG nova.network.neutron [req-b99c8b20-1266-441a-a77c-7e9a61241dac req-a5dd0d5a-4f9a-4aa2-b9f5-547b15da2465 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Updating instance_info_cache with network_info: [{"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:40:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b99c8b20-1266-441a-a77c-7e9a61241dac req-a5dd0d5a-4f9a-4aa2-b9f5-547b15da2465 service nova] Releasing lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:40:53 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d is timed out.
Nov 08 20:40:53 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Successfully detached device vdc from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d from the live domain config.
Nov 08 20:40:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBCbaOrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:40:53 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a46fbb-4d6d-4950-bf5e-339748dffd3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:40:53 user nova-compute[74638]: No targets found.
Nov 08 20:40:53 user nova-compute[74638]: iSNS:
Nov 08 20:40:53 user nova-compute[74638]: No targets found.
Nov 08 20:40:53 user nova-compute[74638]: STATIC:
Nov 08 20:40:53 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6
Nov 08 20:40:53 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:40:53 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:40:53 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310
Nov 08 20:40:53 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:40:53 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:40:53 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3
Nov 08 20:40:53 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:40:53 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:40:53 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f
Nov 08 20:40:53 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:40:53 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:40:53 user nova-compute[74638]: FIRMWARE:
Nov 08 20:40:53 user nova-compute[74638]: No targets found.
Nov 08 20:40:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:40:53 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:40:53 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[369a7fed-f32c-424a-9f01-b1d296320f9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee8aae6-d6b0-41f6-8de9-1ee175460c5c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:40:53 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:40:53 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:40:53 user nova-compute[74638]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 (non-flash)
Nov 08 20:40:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:40:53 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:40:53 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:40:53 user nova-compute[74638]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 (non-flash)
Nov 08 20:40:53 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3e7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d85fded-c34e-47fd-9aa9-5e77fd057a64]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2632e8e-bbfb-4c00-91b2-85e7d4e94426]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2bb1c7-3220-4b54-864b-18b4613b44a6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:53 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[620da648-4945-4027-a49f-25a9be424a75]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[80298974-d6e9-4089-ba38-e045d0eeb1fb]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d74386c-f052-4f3c-82e8-1ee527fa38c8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3, portal: 172.16.0.220,3260]
Nov 08 20:40:54 user nova-compute[74638]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3, portal: 172.16.0.220,3260] successful.
Nov 08 20:40:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fddfbdf-5b29-4fd9-9f34-c58cba042ea3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef3c312-5163-430a-9e59-03c5a572a49b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] <== disconnect_volume: return (332ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:40:54 user nova-compute[74638]: INFO nova.compute.manager [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Detaching volume 4681c825-1c73-47eb-9dac-0bc4861e7b7f
Nov 08 20:40:54 user nova-compute[74638]: INFO nova.virt.block_device [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Attempting to driver detach volume 4681c825-1c73-47eb-9dac-0bc4861e7b7f from mountpoint /dev/vdb
Nov 08 20:40:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Attempting to detach device vdb from instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:40:54 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:40:54 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:40:54 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:40:54 user nova-compute[74638]:   <serial>4681c825-1c73-47eb-9dac-0bc4861e7b7f</serial>
Nov 08 20:40:54 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:40:54 user nova-compute[74638]: </disk>
Nov 08 20:40:54 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:40:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully detached device vdb from instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 from the persistent domain config.
Nov 08 20:40:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:40:54 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:40:54 user nova-compute[74638]:   <source dev="/dev/sde"/>
Nov 08 20:40:54 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:40:54 user nova-compute[74638]:   <serial>4681c825-1c73-47eb-9dac-0bc4861e7b7f</serial>
Nov 08 20:40:54 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:40:54 user nova-compute[74638]: </disk>
Nov 08 20:40:54 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.utils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f6bc88-4c26-4cd9-824b-857fd57dfa5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab025037-d256-42a4-a727-ce91e6ee5720]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe575650-8afb-4ad9-8d89-d0a97a34d94f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada81c24-8e2f-4437-aa96-7bf7e861867d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:40:54 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:40:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6822c9-7bb0-4ff2-bb1e-6c27078c4c73]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG os_brick.utils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:40:54 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Updating existing volume attachment record: c523f870-4a5a-4e42-aaa4-a832dbb3c23f {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:40:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:40:55 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lazy-loading 'flavor' on Instance uuid 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:40:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9b957f81-d6bf-43a1-8673-54beeda5abfc tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.036s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:41:14 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 is timed out.
Nov 08 20:41:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully detached device vdb from instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 from the live domain config.
Nov 08 20:41:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JsBTaDut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:41:14 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c3537c-1e76-48d6-9606-6ff4435ca4e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:41:14 user nova-compute[74638]: No targets found.
Nov 08 20:41:14 user nova-compute[74638]: iSNS:
Nov 08 20:41:14 user nova-compute[74638]: No targets found.
Nov 08 20:41:14 user nova-compute[74638]: STATIC:
Nov 08 20:41:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6
Nov 08 20:41:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:41:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:41:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310
Nov 08 20:41:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:41:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:41:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f
Nov 08 20:41:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:41:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:41:14 user nova-compute[74638]: FIRMWARE:
Nov 08 20:41:14 user nova-compute[74638]: No targets found.
Nov 08 20:41:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:41:14 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:41:14 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b7afd4-da43-49f6-be45-f14838a624ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf5b08d-a214-4851-96b9-0d6f00091458]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:41:14 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:41:14 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:41:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f (non-flash)
Nov 08 20:41:14 user nova-compute[74638]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:41:14 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:41:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c248e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f'): ({'sde'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Removing single pathed devices sde {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca38ecb-44ff-4686-9e7c-516e69db27f4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[52295cc3-4688-46e6-b843-a208d9f22f52]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flushing IO for device /dev/sde {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f945fdf-06ea-4d12-b259-2dcb8b0762c0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[278a9ae7-514c-429e-8d0b-2c365064ed53]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] SCSI volumes sde have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d63004-6860-408b-b701-820babf81082]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f906bb5-5725-4829-9518-9580b76b9168]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f, portal: 172.16.0.220,3260]
Nov 08 20:41:15 user nova-compute[74638]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f, portal: 172.16.0.220,3260] successful.
Nov 08 20:41:15 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4681c825-1c73-47eb-9dac-0bc4861e7b7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[058cf943-2d90-4365-9870-4c1c2d9d20d8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== disconnect_volume: return (322ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:41:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:41:16 user nova-compute[74638]: DEBUG nova.objects.instance [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:41:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-ef79c90a-2d5e-455e-bfc6-2b76220a5c5a tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.008s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:17 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:41:18 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Creating image(s)
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Ensure instance console log exists: /opt/stack/data/nova/instances/a10e16fd-1232-4abd-aa48-439fa6bc75ee/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Start _get_guest_xml network_info=[{"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T20:40:34Z,direct_url=<?>,disk_format='qcow2',id=b6dd0e53-7a84-4fc3-9a20-75ab8074a36e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1732430674',owner='e599a20be834415ea60230b8743a2338',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T20:40:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'c523f870-4a5a-4e42-aaa4-a832dbb3c23f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbUZrkiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a10e16fd-1232-4abd-aa48-439fa6bc75ee', 'attached_at': '', 'detached_at': '', 'volume_id': 'c66fb72c-6104-4df0-850a-4c9d98a7832b', 'serial': 'c66fb72c-6104-4df0-850a-4c9d98a7832b'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:41:18 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:41:18 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T20:40:34Z,direct_url=<?>,disk_format='qcow2',id=b6dd0e53-7a84-4fc3-9a20-75ab8074a36e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1732430674',owner='e599a20be834415ea60230b8743a2338',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T20:40:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbUZrkiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:41:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:41:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:41:18 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915700c-89b3-4b59-a636-2f2b8c269ebb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:41:18 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f9ac6a-aa87-4bf2-b9f3-8b593892ff3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b] added
Nov 08 20:41:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17126ed-6e60-4c0e-8a8b-53d8fb32e1dd]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70b329d-b01c-4ef6-a2db-d758f3452c65]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbUZrkiM {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbUZrkiM" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0e81e1-6b8a-4668-a35a-76ef2df433bf]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QbUZrkiM'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7cb8e3-662b-4545-b44c-08ff2c38942e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced6592-d053-4708-b7af-4e7f9d27d4e1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:41:18 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:41:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:41:18 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:41:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[117bdf06-7e77-4695-9aae-074cc1cdb0e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b, portal: 172.16.0.220,3260]
Nov 08 20:41:18 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b, portal: 172.16.0.220,3260] successful.
Nov 08 20:41:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b8c28-f090-4597-954c-2dab91da9c09]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfe55ab-868e-432a-806b-4d541edbea28]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:41:18 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:41:18 user nova-compute[74638]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)
Nov 08 20:41:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:41:18 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:41:18 user nova-compute[74638]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)
Nov 08 20:41:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759ae98-b22b-44e8-81a9-98a060a2228e]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbUZrkiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:41:18 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23830633933643764', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830633933643764', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1681489820',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1681489820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1681489820',id=44,image_ref='b6dd0e53-7a84-4fc3-9a20-75ab8074a36e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpwsU2l8rKtsVhKql784RGsciD956cjx9qN6yelP842LDPDp7QrgNVd/kGZgTljmK4iHFVfr3Bynt6whcrlRdt2NeVgG3Xp0snFQqv+nFPrgGuQP5C68R0dWjPXWpSFbA==',key_name='tempest-keypair-725239759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-0q5ops40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1116596406',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=a10e16fd-1232-4abd-aa48-439fa6bc75ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:a3,bridge_name='br-int',has_traffic_filtering=True,id=d0e61db5-52dd-402f-b745-332941c01194,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e61db5-52') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.objects.instance [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'pci_devices' on Instance uuid a10e16fd-1232-4abd-aa48-439fa6bc75ee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:41:19 user nova-compute[74638]:   <uuid>a10e16fd-1232-4abd-aa48-439fa6bc75ee</uuid>
Nov 08 20:41:19 user nova-compute[74638]:   <name>instance-0000002c</name>
Nov 08 20:41:19 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:41:19 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:41:19 user nova-compute[74638]:   <metadata>
Nov 08 20:41:19 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:41:19 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:41:19 user nova-compute[74638]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1681489820</nova:name>
Nov 08 20:41:19 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:41:18</nova:creationTime>
Nov 08 20:41:19 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:41:19 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:41:19 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:41:19 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:41:19 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:41:19 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:41:19 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:41:19 user nova-compute[74638]:       <nova:owner>
Nov 08 20:41:19 user nova-compute[74638]:         <nova:user uuid="f63d3b55213f44fbb4dd76758a9a61ed">tempest-TestVolumeBootPattern-1116596406-project-member</nova:user>
Nov 08 20:41:19 user nova-compute[74638]:         <nova:project uuid="e599a20be834415ea60230b8743a2338">tempest-TestVolumeBootPattern-1116596406</nova:project>
Nov 08 20:41:19 user nova-compute[74638]:       </nova:owner>
Nov 08 20:41:19 user nova-compute[74638]:       <nova:root type="image" uuid="b6dd0e53-7a84-4fc3-9a20-75ab8074a36e"/>
Nov 08 20:41:19 user nova-compute[74638]:       <nova:ports>
Nov 08 20:41:19 user nova-compute[74638]:         <nova:port uuid="d0e61db5-52dd-402f-b745-332941c01194">
Nov 08 20:41:19 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 20:41:19 user nova-compute[74638]:         </nova:port>
Nov 08 20:41:19 user nova-compute[74638]:       </nova:ports>
Nov 08 20:41:19 user nova-compute[74638]:     </nova:instance>
Nov 08 20:41:19 user nova-compute[74638]:   </metadata>
Nov 08 20:41:19 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:41:19 user nova-compute[74638]:     <system>
Nov 08 20:41:19 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:41:19 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:41:19 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:41:19 user nova-compute[74638]:       <entry name="serial">a10e16fd-1232-4abd-aa48-439fa6bc75ee</entry>
Nov 08 20:41:19 user nova-compute[74638]:       <entry name="uuid">a10e16fd-1232-4abd-aa48-439fa6bc75ee</entry>
Nov 08 20:41:19 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:41:19 user nova-compute[74638]:     </system>
Nov 08 20:41:19 user nova-compute[74638]:   </sysinfo>
Nov 08 20:41:19 user nova-compute[74638]:   <os>
Nov 08 20:41:19 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:41:19 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:41:19 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:41:19 user nova-compute[74638]:   </os>
Nov 08 20:41:19 user nova-compute[74638]:   <features>
Nov 08 20:41:19 user nova-compute[74638]:     <acpi/>
Nov 08 20:41:19 user nova-compute[74638]:     <apic/>
Nov 08 20:41:19 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:41:19 user nova-compute[74638]:   </features>
Nov 08 20:41:19 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:41:19 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:41:19 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:41:19 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:41:19 user nova-compute[74638]:   </clock>
Nov 08 20:41:19 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:41:19 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:41:19 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:41:19 user nova-compute[74638]:   </cpu>
Nov 08 20:41:19 user nova-compute[74638]:   <devices>
Nov 08 20:41:19 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:41:19 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:41:19 user nova-compute[74638]:       <source dev="/dev/sdb"/>
Nov 08 20:41:19 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:41:19 user nova-compute[74638]:       <serial>c66fb72c-6104-4df0-850a-4c9d98a7832b</serial>
Nov 08 20:41:19 user nova-compute[74638]:     </disk>
Nov 08 20:41:19 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:41:19 user nova-compute[74638]:       <mac address="fa:16:3e:2f:4f:a3"/>
Nov 08 20:41:19 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:41:19 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:41:19 user nova-compute[74638]:       <target dev="tapd0e61db5-52"/>
Nov 08 20:41:19 user nova-compute[74638]:     </interface>
Nov 08 20:41:19 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:41:19 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/a10e16fd-1232-4abd-aa48-439fa6bc75ee/console.log" append="off"/>
Nov 08 20:41:19 user nova-compute[74638]:     </serial>
Nov 08 20:41:19 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:41:19 user nova-compute[74638]:     <video>
Nov 08 20:41:19 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:41:19 user nova-compute[74638]:     </video>
Nov 08 20:41:19 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:41:19 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:41:19 user nova-compute[74638]:     </rng>
Nov 08 20:41:19 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:41:19 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:41:19 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:41:19 user nova-compute[74638]:     </memballoon>
Nov 08 20:41:19 user nova-compute[74638]:   </devices>
Nov 08 20:41:19 user nova-compute[74638]: </domain>
Nov 08 20:41:19 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1681489820',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1681489820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1681489820',id=44,image_ref='b6dd0e53-7a84-4fc3-9a20-75ab8074a36e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpwsU2l8rKtsVhKql784RGsciD956cjx9qN6yelP842LDPDp7QrgNVd/kGZgTljmK4iHFVfr3Bynt6whcrlRdt2NeVgG3Xp0snFQqv+nFPrgGuQP5C68R0dWjPXWpSFbA==',key_name='tempest-keypair-725239759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-0q5ops40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1116596406',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=a10e16fd-1232-4abd-aa48-439fa6bc75ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:a3,bridge_name='br-int',has_traffic_filtering=True,id=d0e61db5-52dd-402f-b745-332941c01194,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e61db5-52') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG os_vif [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:a3,bridge_name='br-int',has_traffic_filtering=True,id=d0e61db5-52dd-402f-b745-332941c01194,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e61db5-52') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '516aa66c-58d4-5c62-a514-0b805769ebff', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0e61db5-52, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0e61db5-52, col_values=(('qos', UUID('1423fd02-c0b7-48a4-b905-17b404a1f476')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0e61db5-52, col_values=(('external_ids', {'iface-id': 'd0e61db5-52dd-402f-b745-332941c01194', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:4f:a3', 'vm-uuid': 'a10e16fd-1232-4abd-aa48-439fa6bc75ee'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:19 user nova-compute[74638]: INFO os_vif [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4f:a3,bridge_name='br-int',has_traffic_filtering=True,id=d0e61db5-52dd-402f-b745-332941c01194,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e61db5-52')
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:41:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No VIF found with MAC fa:16:3e:2f:4f:a3, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:41:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:20 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:41:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-a35371e2-1094-40ed-9087-24cafe5f4083 req-c9d8cfcd-528b-4698-9800-b39c9c9c1353 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Received event network-vif-plugged-d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:41:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a35371e2-1094-40ed-9087-24cafe5f4083 req-c9d8cfcd-528b-4698-9800-b39c9c9c1353 service nova] Acquiring lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a35371e2-1094-40ed-9087-24cafe5f4083 req-c9d8cfcd-528b-4698-9800-b39c9c9c1353 service nova] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a35371e2-1094-40ed-9087-24cafe5f4083 req-c9d8cfcd-528b-4698-9800-b39c9c9c1353 service nova] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-a35371e2-1094-40ed-9087-24cafe5f4083 req-c9d8cfcd-528b-4698-9800-b39c9c9c1353 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] No waiting events found dispatching network-vif-plugged-d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:41:21 user nova-compute[74638]: WARNING nova.compute.manager [req-a35371e2-1094-40ed-9087-24cafe5f4083 req-c9d8cfcd-528b-4698-9800-b39c9c9c1353 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Received unexpected event network-vif-plugged-d0e61db5-52dd-402f-b745-332941c01194 for instance with vm_state building and task_state spawning.
Nov 08 20:41:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:41:23 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Instance spawned successfully.
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-414c7046-4fca-4696-83e2-5d397ceabb7c req-6703dbd0-71de-46d9-ae88-1d19820f61f1 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Received event network-vif-plugged-d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-414c7046-4fca-4696-83e2-5d397ceabb7c req-6703dbd0-71de-46d9-ae88-1d19820f61f1 service nova] Acquiring lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-414c7046-4fca-4696-83e2-5d397ceabb7c req-6703dbd0-71de-46d9-ae88-1d19820f61f1 service nova] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-414c7046-4fca-4696-83e2-5d397ceabb7c req-6703dbd0-71de-46d9-ae88-1d19820f61f1 service nova] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.compute.manager [req-414c7046-4fca-4696-83e2-5d397ceabb7c req-6703dbd0-71de-46d9-ae88-1d19820f61f1 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] No waiting events found dispatching network-vif-plugged-d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:41:23 user nova-compute[74638]: WARNING nova.compute.manager [req-414c7046-4fca-4696-83e2-5d397ceabb7c req-6703dbd0-71de-46d9-ae88-1d19820f61f1 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Received unexpected event network-vif-plugged-d0e61db5-52dd-402f-b745-332941c01194 for instance with vm_state building and task_state spawning.
Nov 08 20:41:23 user nova-compute[74638]: INFO nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:41:23 user nova-compute[74638]: INFO nova.compute.manager [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Took 34.68 seconds to build instance.
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-993c2d68-f062-42c2-9dff-66a402fc68fc tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.784s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:23 user nova-compute[74638]: INFO nova.compute.manager [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Detaching volume 397498e9-bdb5-46ed-941e-2b7e00ff06e6
Nov 08 20:41:23 user nova-compute[74638]: INFO nova.virt.block_device [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Attempting to driver detach volume 397498e9-bdb5-46ed-941e-2b7e00ff06e6 from mountpoint /dev/vdb
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Attempting to detach device vdb from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:41:23 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:41:23 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:41:23 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:41:23 user nova-compute[74638]:   <serial>397498e9-bdb5-46ed-941e-2b7e00ff06e6</serial>
Nov 08 20:41:23 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:41:23 user nova-compute[74638]: </disk>
Nov 08 20:41:23 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:41:23 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Successfully detached device vdb from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d from the persistent domain config.
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:41:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:41:23 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:41:23 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:41:23 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:41:23 user nova-compute[74638]:   <serial>397498e9-bdb5-46ed-941e-2b7e00ff06e6</serial>
Nov 08 20:41:23 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:41:23 user nova-compute[74638]: </disk>
Nov 08 20:41:23 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:41:24 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:41:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:24 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Updating instance_info_cache with network_info: [{"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:41:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:41:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:41:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:41:25 user nova-compute[74638]: INFO nova.compute.claims [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Claim successful on node user
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:41:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.policy [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '055e6d6be11a4365af65a6f5090eee90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c12f4f25aa40889f55cc73ac02a098', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:41:25 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Creating image(s)
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "/opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "/opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "/opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "38a27643173d4be1e9ca2fc0edcce6bc768a847c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "38a27643173d4be1e9ca2fc0edcce6bc768a847c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:25 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c.part --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG nova.network.neutron [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Successfully created port: a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.472s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG nova.virt.images [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] eaff999b-f1b8-436a-af02-c8a314d15c3b was qcow2, converting to raw {{(pid=74638) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG nova.privsep.utils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74638) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c.part /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c.converted {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c.part /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c.converted" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c.converted --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.network.neutron [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Successfully updated port: a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-92402cdd-cc48-4213-9045-e823ca924b7d req-57b2b246-1564-4609-ac0a-d0ccd4f2defd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.manager [req-92402cdd-cc48-4213-9045-e823ca924b7d req-57b2b246-1564-4609-ac0a-d0ccd4f2defd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing instance network info cache due to event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-92402cdd-cc48-4213-9045-e823ca924b7d req-57b2b246-1564-4609-ac0a-d0ccd4f2defd service nova] Acquiring lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-92402cdd-cc48-4213-9045-e823ca924b7d req-57b2b246-1564-4609-ac0a-d0ccd4f2defd service nova] Acquired lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.network.neutron [req-92402cdd-cc48-4213-9045-e823ca924b7d req-57b2b246-1564-4609-ac0a-d0ccd4f2defd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c.converted --force-share --output=json" returned: 0 in 0.682s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "38a27643173d4be1e9ca2fc0edcce6bc768a847c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.573s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:41:27 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:41:27 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=25.124683380126953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.network.neutron [req-92402cdd-cc48-4213-9045-e823ca924b7d req-57b2b246-1564-4609-ac0a-d0ccd4f2defd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f228ded5-9ae6-45eb-b81c-e67b294201a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a10e16fd-1232-4abd-aa48-439fa6bc75ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "38a27643173d4be1e9ca2fc0edcce6bc768a847c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "38a27643173d4be1e9ca2fc0edcce6bc768a847c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.network.neutron [req-92402cdd-cc48-4213-9045-e823ca924b7d req-57b2b246-1564-4609-ac0a-d0ccd4f2defd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-92402cdd-cc48-4213-9045-e823ca924b7d req-57b2b246-1564-4609-ac0a-d0ccd4f2defd service nova] Releasing lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquired lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.network.neutron [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c --force-share --output=json" returned: 0 in 0.204s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c,backing_fmt=raw /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c,backing_fmt=raw /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk 1073741824" returned: 0 in 0.068s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "38a27643173d4be1e9ca2fc0edcce6bc768a847c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.network.neutron [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:41:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c --force-share --output=json" returned: 0 in 0.197s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.network.neutron [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Releasing lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance network_info: |[{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Cannot resize image /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Ensure instance console log exists: /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Start _get_guest_xml network_info=[{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:41:22Z,direct_url=<?>,disk_format='qcow2',id=eaff999b-f1b8-436a-af02-c8a314d15c3b,min_disk=0,min_ram=0,name='tempest-scenario-img--1532305111',owner='45c12f4f25aa40889f55cc73ac02a098',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:41:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'eaff999b-f1b8-436a-af02-c8a314d15c3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:41:28 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:41:28 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:41:22Z,direct_url=<?>,disk_format='qcow2',id=eaff999b-f1b8-436a-af02-c8a314d15c3b,min_disk=0,min_ram=0,name='tempest-scenario-img--1532305111',owner='45c12f4f25aa40889f55cc73ac02a098',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:41:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:41:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1399672828',display_name='tempest-TestMinimumBasicScenario-server-1399672828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1399672828',id=45,image_ref='eaff999b-f1b8-436a-af02-c8a314d15c3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAapiI1Glq1I2Y4Amg3CMzcCNj29SRCbJNPiwJqauOstTYipQICcw0P122r+UBOwk6sIflNPH8QGVhz6QsbLgE8Q6iOi5xKRk6beM5TX4DjsQgY+gekNMJFMjond5Vhi7Q==',key_name='tempest-TestMinimumBasicScenario-1679928950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-vmb2qs48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaff999b-f1b8-436a-af02-c8a314d15c3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:41:26Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=22580a4e-b6c5-466a-911a-7a09e45ee3f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:a5,bridge_name='br-int',has_traffic_filtering=True,id=a36c26bd-d032-4c2f-a938-a7e9f841e116,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c26bd-d0') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'pci_devices' on Instance uuid 22580a4e-b6c5-466a-911a-7a09e45ee3f3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:41:28 user nova-compute[74638]:   <uuid>22580a4e-b6c5-466a-911a-7a09e45ee3f3</uuid>
Nov 08 20:41:28 user nova-compute[74638]:   <name>instance-0000002d</name>
Nov 08 20:41:28 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:41:28 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:41:28 user nova-compute[74638]:   <metadata>
Nov 08 20:41:28 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:41:28 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:41:28 user nova-compute[74638]:       <nova:name>tempest-TestMinimumBasicScenario-server-1399672828</nova:name>
Nov 08 20:41:28 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:41:28</nova:creationTime>
Nov 08 20:41:28 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:41:28 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:41:28 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:41:28 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:41:28 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:41:28 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:41:28 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:41:28 user nova-compute[74638]:       <nova:owner>
Nov 08 20:41:28 user nova-compute[74638]:         <nova:user uuid="055e6d6be11a4365af65a6f5090eee90">tempest-TestMinimumBasicScenario-1423913344-project-member</nova:user>
Nov 08 20:41:28 user nova-compute[74638]:         <nova:project uuid="45c12f4f25aa40889f55cc73ac02a098">tempest-TestMinimumBasicScenario-1423913344</nova:project>
Nov 08 20:41:28 user nova-compute[74638]:       </nova:owner>
Nov 08 20:41:28 user nova-compute[74638]:       <nova:root type="image" uuid="eaff999b-f1b8-436a-af02-c8a314d15c3b"/>
Nov 08 20:41:28 user nova-compute[74638]:       <nova:ports>
Nov 08 20:41:28 user nova-compute[74638]:         <nova:port uuid="a36c26bd-d032-4c2f-a938-a7e9f841e116">
Nov 08 20:41:28 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 20:41:28 user nova-compute[74638]:         </nova:port>
Nov 08 20:41:28 user nova-compute[74638]:       </nova:ports>
Nov 08 20:41:28 user nova-compute[74638]:     </nova:instance>
Nov 08 20:41:28 user nova-compute[74638]:   </metadata>
Nov 08 20:41:28 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:41:28 user nova-compute[74638]:     <system>
Nov 08 20:41:28 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:41:28 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:41:28 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:41:28 user nova-compute[74638]:       <entry name="serial">22580a4e-b6c5-466a-911a-7a09e45ee3f3</entry>
Nov 08 20:41:28 user nova-compute[74638]:       <entry name="uuid">22580a4e-b6c5-466a-911a-7a09e45ee3f3</entry>
Nov 08 20:41:28 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:41:28 user nova-compute[74638]:     </system>
Nov 08 20:41:28 user nova-compute[74638]:   </sysinfo>
Nov 08 20:41:28 user nova-compute[74638]:   <os>
Nov 08 20:41:28 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:41:28 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:41:28 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:41:28 user nova-compute[74638]:   </os>
Nov 08 20:41:28 user nova-compute[74638]:   <features>
Nov 08 20:41:28 user nova-compute[74638]:     <acpi/>
Nov 08 20:41:28 user nova-compute[74638]:     <apic/>
Nov 08 20:41:28 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:41:28 user nova-compute[74638]:   </features>
Nov 08 20:41:28 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:41:28 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:41:28 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:41:28 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:41:28 user nova-compute[74638]:   </clock>
Nov 08 20:41:28 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:41:28 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:41:28 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:41:28 user nova-compute[74638]:   </cpu>
Nov 08 20:41:28 user nova-compute[74638]:   <devices>
Nov 08 20:41:28 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:41:28 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:41:28 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk"/>
Nov 08 20:41:28 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:41:28 user nova-compute[74638]:     </disk>
Nov 08 20:41:28 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:41:28 user nova-compute[74638]:       <mac address="fa:16:3e:51:9a:a5"/>
Nov 08 20:41:28 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:41:28 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:41:28 user nova-compute[74638]:       <target dev="tapa36c26bd-d0"/>
Nov 08 20:41:28 user nova-compute[74638]:     </interface>
Nov 08 20:41:28 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:41:28 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/console.log" append="off"/>
Nov 08 20:41:28 user nova-compute[74638]:     </serial>
Nov 08 20:41:28 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:41:28 user nova-compute[74638]:     <video>
Nov 08 20:41:28 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:41:28 user nova-compute[74638]:     </video>
Nov 08 20:41:28 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:41:28 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:41:28 user nova-compute[74638]:     </rng>
Nov 08 20:41:28 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:41:28 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:41:28 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:41:28 user nova-compute[74638]:     </memballoon>
Nov 08 20:41:28 user nova-compute[74638]:   </devices>
Nov 08 20:41:28 user nova-compute[74638]: </domain>
Nov 08 20:41:28 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:41:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1399672828',display_name='tempest-TestMinimumBasicScenario-server-1399672828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1399672828',id=45,image_ref='eaff999b-f1b8-436a-af02-c8a314d15c3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAapiI1Glq1I2Y4Amg3CMzcCNj29SRCbJNPiwJqauOstTYipQICcw0P122r+UBOwk6sIflNPH8QGVhz6QsbLgE8Q6iOi5xKRk6beM5TX4DjsQgY+gekNMJFMjond5Vhi7Q==',key_name='tempest-TestMinimumBasicScenario-1679928950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-vmb2qs48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaff999b-f1b8-436a-af02-c8a314d15c3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:41:26Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=22580a4e-b6c5-466a-911a-7a09e45ee3f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:a5,bridge_name='br-int',has_traffic_filtering=True,id=a36c26bd-d032-4c2f-a938-a7e9f841e116,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c26bd-d0') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG os_vif [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:a5,bridge_name='br-int',has_traffic_filtering=True,id=a36c26bd-d032-4c2f-a938-a7e9f841e116,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c26bd-d0') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d43dc76-af4c-50fb-8f53-3c820acfe8c2', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa36c26bd-d0, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa36c26bd-d0, col_values=(('qos', UUID('b5c95eda-34aa-4cbc-afad-f86cbddd8f43')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa36c26bd-d0, col_values=(('external_ids', {'iface-id': 'a36c26bd-d032-4c2f-a938-a7e9f841e116', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:9a:a5', 'vm-uuid': '22580a4e-b6c5-466a-911a-7a09e45ee3f3'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:28 user nova-compute[74638]: INFO os_vif [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:9a:a5,bridge_name='br-int',has_traffic_filtering=True,id=a36c26bd-d032-4c2f-a938-a7e9f841e116,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c26bd-d0')
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No VIF found with MAC fa:16:3e:51:9a:a5, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-a7972e4b-a747-49ec-9a3c-acded2031fb9 req-b3f15caa-c963-483e-9898-a495984b1f1c service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a7972e4b-a747-49ec-9a3c-acded2031fb9 req-b3f15caa-c963-483e-9898-a495984b1f1c service nova] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a7972e4b-a747-49ec-9a3c-acded2031fb9 req-b3f15caa-c963-483e-9898-a495984b1f1c service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a7972e4b-a747-49ec-9a3c-acded2031fb9 req-b3f15caa-c963-483e-9898-a495984b1f1c service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-a7972e4b-a747-49ec-9a3c-acded2031fb9 req-b3f15caa-c963-483e-9898-a495984b1f1c service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] No waiting events found dispatching network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:41:29 user nova-compute[74638]: WARNING nova.compute.manager [req-a7972e4b-a747-49ec-9a3c-acded2031fb9 req-b3f15caa-c963-483e-9898-a495984b1f1c service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received unexpected event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 for instance with vm_state building and task_state spawning.
Nov 08 20:41:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:41:31 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance spawned successfully.
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:41:31 user nova-compute[74638]: INFO nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 08 20:41:31 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:41:31 user nova-compute[74638]: INFO nova.compute.manager [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Took 6.72 seconds to build instance.
Nov 08 20:41:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f59edcbe-37ca-4661-9c3b-1d599dab2aa9 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.829s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-a37c2e31-9d8e-4e95-9229-0ce420213d58 req-c3fd1952-0efc-43fc-b070-c6350a19160c service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:41:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a37c2e31-9d8e-4e95-9229-0ce420213d58 req-c3fd1952-0efc-43fc-b070-c6350a19160c service nova] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a37c2e31-9d8e-4e95-9229-0ce420213d58 req-c3fd1952-0efc-43fc-b070-c6350a19160c service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a37c2e31-9d8e-4e95-9229-0ce420213d58 req-c3fd1952-0efc-43fc-b070-c6350a19160c service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:32 user nova-compute[74638]: DEBUG nova.compute.manager [req-a37c2e31-9d8e-4e95-9229-0ce420213d58 req-c3fd1952-0efc-43fc-b070-c6350a19160c service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] No waiting events found dispatching network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:41:32 user nova-compute[74638]: WARNING nova.compute.manager [req-a37c2e31-9d8e-4e95-9229-0ce420213d58 req-c3fd1952-0efc-43fc-b070-c6350a19160c service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received unexpected event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 for instance with vm_state active and task_state None.
Nov 08 20:41:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:44 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d is timed out.
Nov 08 20:41:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Successfully detached device vdb from instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d from the live domain config.
Nov 08 20:41:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amKRJxUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:41:44 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b802b6-c3c6-4c32-be1c-8a06b6cece65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:41:44 user nova-compute[74638]: No targets found.
Nov 08 20:41:44 user nova-compute[74638]: iSNS:
Nov 08 20:41:44 user nova-compute[74638]: No targets found.
Nov 08 20:41:44 user nova-compute[74638]: STATIC:
Nov 08 20:41:44 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6
Nov 08 20:41:44 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:41:44 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:41:44 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b
Nov 08 20:41:44 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:41:44 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:41:44 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310
Nov 08 20:41:44 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:41:44 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:41:44 user nova-compute[74638]: FIRMWARE:
Nov 08 20:41:44 user nova-compute[74638]: No targets found.
Nov 08 20:41:44 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:41:44 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:41:44 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8660d3d4-5df5-4754-8151-db365dc0e99e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c4df16-15f5-4858-9c4e-549703fa1fef]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:41:44 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:41:44 user nova-compute[74638]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)
Nov 08 20:41:44 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:41:44 user nova-compute[74638]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 (non-flash)
Nov 08 20:41:44 user nova-compute[74638]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)
Nov 08 20:41:44 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3ef520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf77d38-8252-41e6-a1c9-bbdf15662e59]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a17dfd-c879-4cf2-b26e-8fd673c4cd82]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b398b152-2e5a-48b2-aeb4-201ad2b2c002]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af268d8-1a18-489e-bbc9-c25204f92229]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[56671b13-f9d8-4050-9f89-cb8d5bc39952]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:44 user nova-compute[74638]: INFO nova.compute.manager [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Terminating instance
Nov 08 20:41:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c06b15-39d9-4093-b41f-15f9526825da]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6, portal: 172.16.0.220,3260]
Nov 08 20:41:44 user nova-compute[74638]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6, portal: 172.16.0.220,3260] successful.
Nov 08 20:41:44 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397498e9-bdb5-46ed-941e-2b7e00ff06e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad8b88b-9cfa-4244-86e7-54c82da730e1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] <== disconnect_volume: return (363ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-127787ec-d801-4081-ae84-a2dde1eeccd5 req-f4bf62a9-cb8d-4df8-8ed7-3895d7c3d01a service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received event network-vif-unplugged-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-127787ec-d801-4081-ae84-a2dde1eeccd5 req-f4bf62a9-cb8d-4df8-8ed7-3895d7c3d01a service nova] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-127787ec-d801-4081-ae84-a2dde1eeccd5 req-f4bf62a9-cb8d-4df8-8ed7-3895d7c3d01a service nova] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-127787ec-d801-4081-ae84-a2dde1eeccd5 req-f4bf62a9-cb8d-4df8-8ed7-3895d7c3d01a service nova] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-127787ec-d801-4081-ae84-a2dde1eeccd5 req-f4bf62a9-cb8d-4df8-8ed7-3895d7c3d01a service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] No waiting events found dispatching network-vif-unplugged-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:41:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-127787ec-d801-4081-ae84-a2dde1eeccd5 req-f4bf62a9-cb8d-4df8-8ed7-3895d7c3d01a service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received event network-vif-unplugged-0c3018e6-09f3-4ded-9202-3400825800e6 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:41:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Instance destroyed successfully.
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'resources' on Instance uuid 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513945935',display_name='tempest-AttachVolumeNegativeTest-server-513945935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513945935',id=39,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtQtH4vm1qt6a/MZ0UGzMNbe8Q+ZsWhHhg6Nd2qcmmWaTyUkQL+bURnBc3saHGHtKVDyGRUDl4ScluTpaFG96DsS8G2tJXHHMpYss1m+AHWKNCRTVPF6FXCKXOGue1NeQ==',key_name='tempest-keypair-927949813',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:35:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-g7homwth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=73254bd4-9fd9-481e-9a83-8ddeb6dd3f50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "0c3018e6-09f3-4ded-9202-3400825800e6", "address": "fa:16:3e:cb:22:8d", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3018e6-09", "ovs_interfaceid": "0c3018e6-09f3-4ded-9202-3400825800e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=0c3018e6-09f3-4ded-9202-3400825800e6,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3018e6-09') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG os_vif [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=0c3018e6-09f3-4ded-9202-3400825800e6,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3018e6-09') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c3018e6-09, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa7326bc-9fb4-4f20-aa74-9cd3865d1190) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:45 user nova-compute[74638]: INFO os_vif [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:22:8d,bridge_name='br-int',has_traffic_filtering=True,id=0c3018e6-09f3-4ded-9202-3400825800e6,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3018e6-09')
Nov 08 20:41:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Deleting instance files /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50_del
Nov 08 20:41:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Deletion of /opt/stack/data/nova/instances/73254bd4-9fd9-481e-9a83-8ddeb6dd3f50_del complete
Nov 08 20:41:45 user nova-compute[74638]: INFO nova.compute.manager [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Verify base images {{(pid=74638) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Image id eaff999b-f1b8-436a-af02-c8a314d15c3b yields fingerprint 38a27643173d4be1e9ca2fc0edcce6bc768a847c {{(pid=74638) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 20:41:45 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] image eaff999b-f1b8-436a-af02-c8a314d15c3b at (/opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c): checking
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] image eaff999b-f1b8-436a-af02-c8a314d15c3b at (/opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c): image is in use {{(pid=74638) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74638) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Image id b6dd0e53-7a84-4fc3-9a20-75ab8074a36e yields fingerprint 81a52c0089cbf52833ecc32f97cf47d10e0852f0 {{(pid=74638) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Image id 2378b081-1a49-4717-81bb-a291ba1a9d32 yields fingerprint 4487219dd3b0c43ad4e302ef25c357777ad2c835 {{(pid=74638) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 20:41:45 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] image 2378b081-1a49-4717-81bb-a291ba1a9d32 at (/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835): checking
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] image 2378b081-1a49-4717-81bb-a291ba1a9d32 at (/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835): image is in use {{(pid=74638) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] 22580a4e-b6c5-466a-911a-7a09e45ee3f3 is a valid instance name {{(pid=74638) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] 22580a4e-b6c5-466a-911a-7a09e45ee3f3 has a disk file {{(pid=74638) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 is backed by 38a27643173d4be1e9ca2fc0edcce6bc768a847c {{(pid=74638) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] f228ded5-9ae6-45eb-b81c-e67b294201a4 is a valid instance name {{(pid=74638) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] a10e16fd-1232-4abd-aa48-439fa6bc75ee is a valid instance name {{(pid=74638) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d is a valid instance name {{(pid=74638) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d has a disk file {{(pid=74638) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 20:41:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d is backed by 4487219dd3b0c43ad4e302ef25c357777ad2c835 {{(pid=74638) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Unknown base file: /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Unknown base file: /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Unknown base file: /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Unknown base file: /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Unknown base file: /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Unknown base file: /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Unknown base file: /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Unknown base file: /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Active base files: /opt/stack/data/nova/instances/_base/38a27643173d4be1e9ca2fc0edcce6bc768a847c /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Removable base files: /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183 /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156 /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0 /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b051ce37e1311128c2eb37df9827de7dab0228bc
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aa8f926f0f10945ac0d39cc8624142a698493d6a
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/769addcaff4416d80d8d18286d408525805b0afe
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/985d7b376f61d5d5973f9c78f51e2041ae70d183
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/06f2bc14927e5cf5aaf0a9d35927e189f4a51156
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6c9db9b9004e535c14a97d90eb537720e111a5c0
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b2970da4f7013bec5f746ce9bcb89b20d539cc6f
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/17723cbacd0297de00c17c0e4792abf2a9426859
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Verification complete {{(pid=74638) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Verify swap images {{(pid=74638) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.imagecache [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Verify ephemeral images {{(pid=74638) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lazy-loading 'flavor' on Instance uuid 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Took 0.86 seconds to deallocate network for instance.
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-2c269279-fdf4-4e44-9755-01d6645e7ab6 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.644s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:46 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Deleted allocations for instance 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a3e6f0e1-1c4d-4fac-86f0-465c5d53f0e3 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.161s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfa3a4be-bc13-427a-b6f1-5aa1346cdbc7 req-1d91aa29-6f60-47a8-bcc7-f7c7b64b9407 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received event network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfa3a4be-bc13-427a-b6f1-5aa1346cdbc7 req-1d91aa29-6f60-47a8-bcc7-f7c7b64b9407 service nova] Acquiring lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfa3a4be-bc13-427a-b6f1-5aa1346cdbc7 req-1d91aa29-6f60-47a8-bcc7-f7c7b64b9407 service nova] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfa3a4be-bc13-427a-b6f1-5aa1346cdbc7 req-1d91aa29-6f60-47a8-bcc7-f7c7b64b9407 service nova] Lock "73254bd4-9fd9-481e-9a83-8ddeb6dd3f50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfa3a4be-bc13-427a-b6f1-5aa1346cdbc7 req-1d91aa29-6f60-47a8-bcc7-f7c7b64b9407 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] No waiting events found dispatching network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:41:46 user nova-compute[74638]: WARNING nova.compute.manager [req-dfa3a4be-bc13-427a-b6f1-5aa1346cdbc7 req-1d91aa29-6f60-47a8-bcc7-f7c7b64b9407 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received unexpected event network-vif-plugged-0c3018e6-09f3-4ded-9202-3400825800e6 for instance with vm_state deleted and task_state None.
Nov 08 20:41:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfa3a4be-bc13-427a-b6f1-5aa1346cdbc7 req-1d91aa29-6f60-47a8-bcc7-f7c7b64b9407 service nova] [instance: 73254bd4-9fd9-481e-9a83-8ddeb6dd3f50] Received event network-vif-deleted-0c3018e6-09f3-4ded-9202-3400825800e6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:41:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:41:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:14 user nova-compute[74638]: INFO nova.compute.manager [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Terminating instance
Nov 08 20:42:14 user nova-compute[74638]: DEBUG nova.compute.manager [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG nova.compute.manager [req-fe1dacad-c6f7-4d8e-b818-dd3fb4f64d15 req-26044bee-67ce-4090-ba7a-61bacb0696ad service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received event network-vif-unplugged-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fe1dacad-c6f7-4d8e-b818-dd3fb4f64d15 req-26044bee-67ce-4090-ba7a-61bacb0696ad service nova] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fe1dacad-c6f7-4d8e-b818-dd3fb4f64d15 req-26044bee-67ce-4090-ba7a-61bacb0696ad service nova] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-fe1dacad-c6f7-4d8e-b818-dd3fb4f64d15 req-26044bee-67ce-4090-ba7a-61bacb0696ad service nova] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG nova.compute.manager [req-fe1dacad-c6f7-4d8e-b818-dd3fb4f64d15 req-26044bee-67ce-4090-ba7a-61bacb0696ad service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] No waiting events found dispatching network-vif-unplugged-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:42:14 user nova-compute[74638]: DEBUG nova.compute.manager [req-fe1dacad-c6f7-4d8e-b818-dd3fb4f64d15 req-26044bee-67ce-4090-ba7a-61bacb0696ad service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received event network-vif-unplugged-e7e6b658-d441-4491-90dc-91a5ab29d006 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:42:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Instance destroyed successfully.
Nov 08 20:42:14 user nova-compute[74638]: DEBUG nova.objects.instance [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lazy-loading 'resources' on Instance uuid 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1271273190',display_name='tempest-TestServerVolumeAttachmentScenario-server-1271273190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1271273190',id=41,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmnr6SxFcRAp0IZQiyqHzp0EnyU0AC626lPjgBXqH+Q24qS4nCPRsgra3C3PD6K854Bm+bgozdV/BmkOa3Ov7lu56SwP7xIX3S2DbyHe572slLiWZicYoaG/ZD5zHBFSQ==',key_name='tempest-keypair-579774605',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adf0f58077f44ca890858170ed8b1a1d',ramdisk_id='',reservation_id='r-p7usrme9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-710922255',owner_user_name='tempest-TestServerVolumeAttachmentScenario-710922255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:37:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05842022c6fe4a02b2a5d4ff1bae8825',uuid=8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Converting VIF {"id": "e7e6b658-d441-4491-90dc-91a5ab29d006", "address": "fa:16:3e:57:dc:33", "network": {"id": "0252b2da-ee01-41bf-8462-d421013510b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-76483190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adf0f58077f44ca890858170ed8b1a1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e6b658-d4", "ovs_interfaceid": "e7e6b658-d441-4491-90dc-91a5ab29d006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:dc:33,bridge_name='br-int',has_traffic_filtering=True,id=e7e6b658-d441-4491-90dc-91a5ab29d006,network=Network(0252b2da-ee01-41bf-8462-d421013510b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e6b658-d4') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG os_vif [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:dc:33,bridge_name='br-int',has_traffic_filtering=True,id=e7e6b658-d441-4491-90dc-91a5ab29d006,network=Network(0252b2da-ee01-41bf-8462-d421013510b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e6b658-d4') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7e6b658-d4, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df9ba7c5-f3a4-4d53-9d92-58a3d63ec2fe) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:15 user nova-compute[74638]: INFO os_vif [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:dc:33,bridge_name='br-int',has_traffic_filtering=True,id=e7e6b658-d441-4491-90dc-91a5ab29d006,network=Network(0252b2da-ee01-41bf-8462-d421013510b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e6b658-d4')
Nov 08 20:42:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Deleting instance files /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d_del
Nov 08 20:42:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Deletion of /opt/stack/data/nova/instances/8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d_del complete
Nov 08 20:42:15 user nova-compute[74638]: INFO nova.compute.manager [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 20:42:15 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:42:15 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:42:16 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Took 1.12 seconds to deallocate network for instance.
Nov 08 20:42:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-638e62dd-2223-4e86-9224-13ab0ff86794 req-664c071a-7312-4802-bc17-2ee4f84589ec service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received event network-vif-deleted-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:16 user nova-compute[74638]: INFO nova.compute.manager [req-638e62dd-2223-4e86-9224-13ab0ff86794 req-664c071a-7312-4802-bc17-2ee4f84589ec service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Neutron deleted interface e7e6b658-d441-4491-90dc-91a5ab29d006; detaching it from the instance and deleting it from the info cache
Nov 08 20:42:16 user nova-compute[74638]: DEBUG nova.network.neutron [req-638e62dd-2223-4e86-9224-13ab0ff86794 req-664c071a-7312-4802-bc17-2ee4f84589ec service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-638e62dd-2223-4e86-9224-13ab0ff86794 req-664c071a-7312-4802-bc17-2ee4f84589ec service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Detach interface failed, port_id=e7e6b658-d441-4491-90dc-91a5ab29d006, reason: Instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:16 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Deleted allocations for instance 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d
Nov 08 20:42:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-f7fa7848-ef7b-4542-9061-7fcb6af322c1 tempest-TestServerVolumeAttachmentScenario-710922255 tempest-TestServerVolumeAttachmentScenario-710922255-project-member] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.438s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-2af03742-c7b2-41d5-bf91-72e237419d38 req-edd5757e-59d8-42ba-bfcd-3b6ab2a99730 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received event network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2af03742-c7b2-41d5-bf91-72e237419d38 req-edd5757e-59d8-42ba-bfcd-3b6ab2a99730 service nova] Acquiring lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2af03742-c7b2-41d5-bf91-72e237419d38 req-edd5757e-59d8-42ba-bfcd-3b6ab2a99730 service nova] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-2af03742-c7b2-41d5-bf91-72e237419d38 req-edd5757e-59d8-42ba-bfcd-3b6ab2a99730 service nova] Lock "8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-2af03742-c7b2-41d5-bf91-72e237419d38 req-edd5757e-59d8-42ba-bfcd-3b6ab2a99730 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] No waiting events found dispatching network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:42:16 user nova-compute[74638]: WARNING nova.compute.manager [req-2af03742-c7b2-41d5-bf91-72e237419d38 req-edd5757e-59d8-42ba-bfcd-3b6ab2a99730 service nova] [instance: 8ceccb0d-3128-4ca3-a8d8-e6ef6cb12c6d] Received unexpected event network-vif-plugged-e7e6b658-d441-4491-90dc-91a5ab29d006 for instance with vm_state deleted and task_state None.
Nov 08 20:42:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:22 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:42:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:42:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:42:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:42:27 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:42:27 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8555MB free_disk=25.10015869140625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f228ded5-9ae6-45eb-b81c-e67b294201a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a10e16fd-1232-4abd-aa48-439fa6bc75ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:42:27 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:42:28 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:42:28 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:42:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:42:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:42:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:42:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:42:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:42:38 user nova-compute[74638]: INFO nova.compute.claims [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Claim successful on node user
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:42:38 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:42:38 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Creating image(s)
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "/opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "/opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "/opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG nova.policy [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55df27e8271941e8ac7825d6999ce486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349308d9cb9419f9981a9d28ea61248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:42:38 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.199s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-8ed8db7e-5c7a-4424-892f-24a1fb953a97 req-e95abb49-2db1-4596-97cc-bce1717f1ed2 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Received event network-changed-d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG nova.compute.manager [req-8ed8db7e-5c7a-4424-892f-24a1fb953a97 req-e95abb49-2db1-4596-97cc-bce1717f1ed2 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Refreshing instance network info cache due to event network-changed-d0e61db5-52dd-402f-b745-332941c01194. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ed8db7e-5c7a-4424-892f-24a1fb953a97 req-e95abb49-2db1-4596-97cc-bce1717f1ed2 service nova] Acquiring lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ed8db7e-5c7a-4424-892f-24a1fb953a97 req-e95abb49-2db1-4596-97cc-bce1717f1ed2 service nova] Acquired lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ed8db7e-5c7a-4424-892f-24a1fb953a97 req-e95abb49-2db1-4596-97cc-bce1717f1ed2 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Refreshing network info cache for port d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.189s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk 1073741824" returned: 0 in 0.057s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.227s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Cannot resize image /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Ensure instance console log exists: /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ed8db7e-5c7a-4424-892f-24a1fb953a97 req-e95abb49-2db1-4596-97cc-bce1717f1ed2 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Updated VIF entry in instance network info cache for port d0e61db5-52dd-402f-b745-332941c01194. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.network.neutron [req-8ed8db7e-5c7a-4424-892f-24a1fb953a97 req-e95abb49-2db1-4596-97cc-bce1717f1ed2 service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Updating instance_info_cache with network_info: [{"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ed8db7e-5c7a-4424-892f-24a1fb953a97 req-e95abb49-2db1-4596-97cc-bce1717f1ed2 service nova] Releasing lock "refresh_cache-a10e16fd-1232-4abd-aa48-439fa6bc75ee" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Successfully created port: 07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:40 user nova-compute[74638]: INFO nova.compute.manager [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Terminating instance
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Successfully updated port: 07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquired lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.compute.manager [req-56209dad-b450-4d52-a17e-6f0e9e91bf86 req-ef624bac-85e3-4849-b7d4-256037650b09 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received event network-changed-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.compute.manager [req-56209dad-b450-4d52-a17e-6f0e9e91bf86 req-ef624bac-85e3-4849-b7d4-256037650b09 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Refreshing instance network info cache due to event network-changed-07ff1024-998d-4046-b513-4ac17e1014bc. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-56209dad-b450-4d52-a17e-6f0e9e91bf86 req-ef624bac-85e3-4849-b7d4-256037650b09 service nova] Acquiring lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:42:40 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Instance destroyed successfully.
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.objects.instance [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'resources' on Instance uuid a10e16fd-1232-4abd-aa48-439fa6bc75ee {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:40:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1681489820',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1681489820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1681489820',id=44,image_ref='b6dd0e53-7a84-4fc3-9a20-75ab8074a36e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpwsU2l8rKtsVhKql784RGsciD956cjx9qN6yelP842LDPDp7QrgNVd/kGZgTljmK4iHFVfr3Bynt6whcrlRdt2NeVgG3Xp0snFQqv+nFPrgGuQP5C68R0dWjPXWpSFbA==',key_name='tempest-keypair-725239759',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:41:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-0q5ops40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1116596406',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=a10e16fd-1232-4abd-aa48-439fa6bc75ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "d0e61db5-52dd-402f-b745-332941c01194", "address": "fa:16:3e:2f:4f:a3", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e61db5-52", "ovs_interfaceid": "d0e61db5-52dd-402f-b745-332941c01194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4f:a3,bridge_name='br-int',has_traffic_filtering=True,id=d0e61db5-52dd-402f-b745-332941c01194,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e61db5-52') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG os_vif [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4f:a3,bridge_name='br-int',has_traffic_filtering=True,id=d0e61db5-52dd-402f-b745-332941c01194,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e61db5-52') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0e61db5-52, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1423fd02-c0b7-48a4-b905-17b404a1f476) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:41 user nova-compute[74638]: INFO os_vif [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4f:a3,bridge_name='br-int',has_traffic_filtering=True,id=d0e61db5-52dd-402f-b745-332941c01194,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e61db5-52')
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbUZrkiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:42:41 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f716c0a-2cdf-432d-9ba4-7994642fc512]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:42:41 user nova-compute[74638]: No targets found.
Nov 08 20:42:41 user nova-compute[74638]: iSNS:
Nov 08 20:42:41 user nova-compute[74638]: No targets found.
Nov 08 20:42:41 user nova-compute[74638]: STATIC:
Nov 08 20:42:41 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b
Nov 08 20:42:41 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:42:41 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:42:41 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310
Nov 08 20:42:41 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:42:41 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:42:41 user nova-compute[74638]: FIRMWARE:
Nov 08 20:42:41 user nova-compute[74638]: No targets found.
Nov 08 20:42:41 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:42:41 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:42:41 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3587b92-fa6f-4b29-a834-a9ca90aa697c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b761f-f060-494d-9cfc-3cc3f4b11320]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:42:41 user nova-compute[74638]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)
Nov 08 20:42:41 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:42:41 user nova-compute[74638]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b (non-flash)
Nov 08 20:42:41 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c35db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e0edf-4bd2-4816-8227-4d24444a2c8e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4d048b-a1a4-4035-b5d2-373808ec34a7]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fdbfbf-0762-45e0-86a0-d1ba738490ae]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updating instance_info_cache with network_info: [{"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Releasing lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Instance network_info: |[{"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-56209dad-b450-4d52-a17e-6f0e9e91bf86 req-ef624bac-85e3-4849-b7d4-256037650b09 service nova] Acquired lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-56209dad-b450-4d52-a17e-6f0e9e91bf86 req-ef624bac-85e3-4849-b7d4-256037650b09 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Refreshing network info cache for port 07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Start _get_guest_xml network_info=[{"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:42:41 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:42:41 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000017643',display_name='tempest-AttachVolumeNegativeTest-server-2000017643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000017643',id=46,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZTRTeI5adKerwZkrhjTkKCkyG/y7cMff9B0WF5Frmsahpg79yU8TltgZ9fT25B76+E9/+dqDzZ5fdx4U5S49qw+NeYZMB3NX5gDGkALDSFZ3S+egWZnZAFHJMt6JQJjQ==',key_name='tempest-keypair-651773704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-8pzy5i5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=53324df5-af4d-4c77-88e5-ae46854e8214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:69:d7,bridge_name='br-int',has_traffic_filtering=True,id=07ff1024-998d-4046-b513-4ac17e1014bc,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ff1024-99') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.objects.instance [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'pci_devices' on Instance uuid 53324df5-af4d-4c77-88e5-ae46854e8214 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.148s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dbc172-5ca7-4d4e-bd24-b04319844d12]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd67f0609-80c93d7dc13a0dc8', '/dev/disk/by-id/scsi-23830633933643764', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d67f0609') {{(pid=85977) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3badc144-63eb-4f58-b2c6-59c1e1deb693]: (4, None) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:42:41 user nova-compute[74638]:   <uuid>53324df5-af4d-4c77-88e5-ae46854e8214</uuid>
Nov 08 20:42:41 user nova-compute[74638]:   <name>instance-0000002e</name>
Nov 08 20:42:41 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:42:41 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:42:41 user nova-compute[74638]:   <metadata>
Nov 08 20:42:41 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:42:41 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:42:41 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2000017643</nova:name>
Nov 08 20:42:41 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:42:41</nova:creationTime>
Nov 08 20:42:41 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:42:41 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:42:41 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:42:41 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:42:41 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:42:41 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:42:41 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:42:41 user nova-compute[74638]:       <nova:owner>
Nov 08 20:42:41 user nova-compute[74638]:         <nova:user uuid="55df27e8271941e8ac7825d6999ce486">tempest-AttachVolumeNegativeTest-1913966386-project-member</nova:user>
Nov 08 20:42:41 user nova-compute[74638]:         <nova:project uuid="a349308d9cb9419f9981a9d28ea61248">tempest-AttachVolumeNegativeTest-1913966386</nova:project>
Nov 08 20:42:41 user nova-compute[74638]:       </nova:owner>
Nov 08 20:42:41 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:42:41 user nova-compute[74638]:       <nova:ports>
Nov 08 20:42:41 user nova-compute[74638]:         <nova:port uuid="07ff1024-998d-4046-b513-4ac17e1014bc">
Nov 08 20:42:41 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 20:42:41 user nova-compute[74638]:         </nova:port>
Nov 08 20:42:41 user nova-compute[74638]:       </nova:ports>
Nov 08 20:42:41 user nova-compute[74638]:     </nova:instance>
Nov 08 20:42:41 user nova-compute[74638]:   </metadata>
Nov 08 20:42:41 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:42:41 user nova-compute[74638]:     <system>
Nov 08 20:42:41 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:42:41 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:42:41 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:42:41 user nova-compute[74638]:       <entry name="serial">53324df5-af4d-4c77-88e5-ae46854e8214</entry>
Nov 08 20:42:41 user nova-compute[74638]:       <entry name="uuid">53324df5-af4d-4c77-88e5-ae46854e8214</entry>
Nov 08 20:42:41 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:42:41 user nova-compute[74638]:     </system>
Nov 08 20:42:41 user nova-compute[74638]:   </sysinfo>
Nov 08 20:42:41 user nova-compute[74638]:   <os>
Nov 08 20:42:41 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:42:41 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:42:41 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:42:41 user nova-compute[74638]:   </os>
Nov 08 20:42:41 user nova-compute[74638]:   <features>
Nov 08 20:42:41 user nova-compute[74638]:     <acpi/>
Nov 08 20:42:41 user nova-compute[74638]:     <apic/>
Nov 08 20:42:41 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:42:41 user nova-compute[74638]:   </features>
Nov 08 20:42:41 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:42:41 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:42:41 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:42:41 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:42:41 user nova-compute[74638]:   </clock>
Nov 08 20:42:41 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:42:41 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:42:41 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:42:41 user nova-compute[74638]:   </cpu>
Nov 08 20:42:41 user nova-compute[74638]:   <devices>
Nov 08 20:42:41 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:42:41 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:42:41 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk"/>
Nov 08 20:42:41 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:42:41 user nova-compute[74638]:     </disk>
Nov 08 20:42:41 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:42:41 user nova-compute[74638]:       <mac address="fa:16:3e:2e:69:d7"/>
Nov 08 20:42:41 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:42:41 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:42:41 user nova-compute[74638]:       <target dev="tap07ff1024-99"/>
Nov 08 20:42:41 user nova-compute[74638]:     </interface>
Nov 08 20:42:41 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:42:41 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/console.log" append="off"/>
Nov 08 20:42:41 user nova-compute[74638]:     </serial>
Nov 08 20:42:41 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:42:41 user nova-compute[74638]:     <video>
Nov 08 20:42:41 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:42:41 user nova-compute[74638]:     </video>
Nov 08 20:42:41 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:42:41 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:42:41 user nova-compute[74638]:     </rng>
Nov 08 20:42:41 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:42:41 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:42:41 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:42:41 user nova-compute[74638]:     </memballoon>
Nov 08 20:42:41 user nova-compute[74638]:   </devices>
Nov 08 20:42:41 user nova-compute[74638]: </domain>
Nov 08 20:42:41 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000017643',display_name='tempest-AttachVolumeNegativeTest-server-2000017643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000017643',id=46,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZTRTeI5adKerwZkrhjTkKCkyG/y7cMff9B0WF5Frmsahpg79yU8TltgZ9fT25B76+E9/+dqDzZ5fdx4U5S49qw+NeYZMB3NX5gDGkALDSFZ3S+egWZnZAFHJMt6JQJjQ==',key_name='tempest-keypair-651773704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-8pzy5i5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=53324df5-af4d-4c77-88e5-ae46854e8214,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:69:d7,bridge_name='br-int',has_traffic_filtering=True,id=07ff1024-998d-4046-b513-4ac17e1014bc,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ff1024-99') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_vif [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:69:d7,bridge_name='br-int',has_traffic_filtering=True,id=07ff1024-998d-4046-b513-4ac17e1014bc,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ff1024-99') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6d92f80-cd13-5e5c-bd20-a5e5e0d15e29', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c47176-0f49-441b-808f-1d22f206dacc]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07ff1024-99, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07ff1024-99, col_values=(('qos', UUID('8284aa9f-ab74-4d49-89e7-c63515944e44')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07ff1024-99, col_values=(('external_ids', {'iface-id': '07ff1024-998d-4046-b513-4ac17e1014bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:69:d7', 'vm-uuid': '53324df5-af4d-4c77-88e5-ae46854e8214'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:41 user nova-compute[74638]: INFO os_vif [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:69:d7,bridge_name='br-int',has_traffic_filtering=True,id=07ff1024-998d-4046-b513-4ac17e1014bc,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ff1024-99')
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f16a62-bf7a-4ab7-b61e-1bd363d21e2b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b, portal: 172.16.0.220,3260]
Nov 08 20:42:41 user nova-compute[74638]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b, portal: 172.16.0.220,3260] successful.
Nov 08 20:42:41 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66fb72c-6104-4df0-850a-4c9d98a7832b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No VIF found with MAC fa:16:3e:2e:69:d7, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[59647507-e5a3-4d52-9305-08937f257610]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== disconnect_volume: return (453ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:42:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Deleting instance files /opt/stack/data/nova/instances/a10e16fd-1232-4abd-aa48-439fa6bc75ee_del
Nov 08 20:42:41 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Deletion of /opt/stack/data/nova/instances/a10e16fd-1232-4abd-aa48-439fa6bc75ee_del complete
Nov 08 20:42:41 user nova-compute[74638]: INFO nova.compute.manager [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-56209dad-b450-4d52-a17e-6f0e9e91bf86 req-ef624bac-85e3-4849-b7d4-256037650b09 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updated VIF entry in instance network info cache for port 07ff1024-998d-4046-b513-4ac17e1014bc. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-56209dad-b450-4d52-a17e-6f0e9e91bf86 req-ef624bac-85e3-4849-b7d4-256037650b09 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updating instance_info_cache with network_info: [{"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:42:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-56209dad-b450-4d52-a17e-6f0e9e91bf86 req-ef624bac-85e3-4849-b7d4-256037650b09 service nova] Releasing lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:42:42 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:42:42 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Took 0.95 seconds to deallocate network for instance.
Nov 08 20:42:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-9b912c43-7ad4-44f6-bdc7-da9ac9ce4a48 req-cb402260-1fb7-440f-8bc1-9dd3968fcc6e service nova] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Received event network-vif-deleted-d0e61db5-52dd-402f-b745-332941c01194 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:43 user nova-compute[74638]: INFO nova.compute.manager [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Took 0.99 seconds to detach 1 volumes for instance.
Nov 08 20:42:43 user nova-compute[74638]: DEBUG nova.compute.manager [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a10e16fd-1232-4abd-aa48-439fa6bc75ee] Deleting volume: c66fb72c-6104-4df0-850a-4c9d98a7832b {{(pid=74638) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:43 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Deleted allocations for instance a10e16fd-1232-4abd-aa48-439fa6bc75ee
Nov 08 20:42:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-d92b840a-57a3-453e-9f18-aaf2e61bc927 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a10e16fd-1232-4abd-aa48-439fa6bc75ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.794s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:42:44 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Instance spawned successfully.
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:44 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:45 user nova-compute[74638]: INFO nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 08 20:42:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:42:45 user nova-compute[74638]: INFO nova.compute.manager [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Took 6.86 seconds to build instance.
Nov 08 20:42:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-eee2c5fe-e95b-43ea-9e3e-4fcc5c239fbf tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.982s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-bea970a3-23ba-4d26-b328-413df49109ef req-70acae79-78c4-49f5-90c0-104d8708e2bd service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received event network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bea970a3-23ba-4d26-b328-413df49109ef req-70acae79-78c4-49f5-90c0-104d8708e2bd service nova] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bea970a3-23ba-4d26-b328-413df49109ef req-70acae79-78c4-49f5-90c0-104d8708e2bd service nova] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-bea970a3-23ba-4d26-b328-413df49109ef req-70acae79-78c4-49f5-90c0-104d8708e2bd service nova] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-bea970a3-23ba-4d26-b328-413df49109ef req-70acae79-78c4-49f5-90c0-104d8708e2bd service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] No waiting events found dispatching network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:42:45 user nova-compute[74638]: WARNING nova.compute.manager [req-bea970a3-23ba-4d26-b328-413df49109ef req-70acae79-78c4-49f5-90c0-104d8708e2bd service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received unexpected event network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc for instance with vm_state active and task_state None.
Nov 08 20:42:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "69c97586-e36e-45c7-bc68-cf01577b56e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-07406c2d-6be4-4f34-b47c-dd1fe3d69d67 req-f2a40844-7e1f-4011-ba6f-bb2c67efc347 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received event network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07406c2d-6be4-4f34-b47c-dd1fe3d69d67 req-f2a40844-7e1f-4011-ba6f-bb2c67efc347 service nova] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07406c2d-6be4-4f34-b47c-dd1fe3d69d67 req-f2a40844-7e1f-4011-ba6f-bb2c67efc347 service nova] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-07406c2d-6be4-4f34-b47c-dd1fe3d69d67 req-f2a40844-7e1f-4011-ba6f-bb2c67efc347 service nova] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-07406c2d-6be4-4f34-b47c-dd1fe3d69d67 req-f2a40844-7e1f-4011-ba6f-bb2c67efc347 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] No waiting events found dispatching network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:42:48 user nova-compute[74638]: WARNING nova.compute.manager [req-07406c2d-6be4-4f34-b47c-dd1fe3d69d67 req-f2a40844-7e1f-4011-ba6f-bb2c67efc347 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received unexpected event network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc for instance with vm_state active and task_state None.
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:42:48 user nova-compute[74638]: INFO nova.compute.claims [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Claim successful on node user
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:42:48 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.policy [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c2f15bfede04cd4a2e447906b5aea01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320a8bc7e5964a9c980dcd15768cd558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:42:48 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Creating image(s)
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "/opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "/opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "/opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.203s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.218s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Successfully created port: 09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk 1073741824" returned: 0 in 0.061s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.179s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Cannot resize image /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Ensure instance console log exists: /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Successfully updated port: 09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "refresh_cache-69c97586-e36e-45c7-bc68-cf01577b56e1" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquired lock "refresh_cache-69c97586-e36e-45c7-bc68-cf01577b56e1" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-e0df9079-d620-4d8b-af65-7af1020042f5 req-706955a6-cbec-4c58-a15f-8d1a32b19b40 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received event network-changed-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-e0df9079-d620-4d8b-af65-7af1020042f5 req-706955a6-cbec-4c58-a15f-8d1a32b19b40 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Refreshing instance network info cache due to event network-changed-09fcc9f0-5973-4107-af13-08d0ae7d22ee. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e0df9079-d620-4d8b-af65-7af1020042f5 req-706955a6-cbec-4c58-a15f-8d1a32b19b40 service nova] Acquiring lock "refresh_cache-69c97586-e36e-45c7-bc68-cf01577b56e1" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:42:49 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Updating instance_info_cache with network_info: [{"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Releasing lock "refresh_cache-69c97586-e36e-45c7-bc68-cf01577b56e1" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Instance network_info: |[{"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e0df9079-d620-4d8b-af65-7af1020042f5 req-706955a6-cbec-4c58-a15f-8d1a32b19b40 service nova] Acquired lock "refresh_cache-69c97586-e36e-45c7-bc68-cf01577b56e1" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.network.neutron [req-e0df9079-d620-4d8b-af65-7af1020042f5 req-706955a6-cbec-4c58-a15f-8d1a32b19b40 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Refreshing network info cache for port 09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Start _get_guest_xml network_info=[{"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:42:50 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:42:50 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1094554414',display_name='tempest-VolumesActionsTest-instance-1094554414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1094554414',id=47,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='320a8bc7e5964a9c980dcd15768cd558',ramdisk_id='',reservation_id='r-j3iaauft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1219331857',owner_user_name='tempest-VolumesActionsTest-1219331857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:42:49Z,user_data=None,user_id='6c2f15bfede04cd4a2e447906b5aea01',uuid=69c97586-e36e-45c7-bc68-cf01577b56e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Converting VIF {"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=09fcc9f0-5973-4107-af13-08d0ae7d22ee,network=Network(185d228f-e8b4-47be-85d5-350af82d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fcc9f0-59') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.objects.instance [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lazy-loading 'pci_devices' on Instance uuid 69c97586-e36e-45c7-bc68-cf01577b56e1 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:42:50 user nova-compute[74638]:   <uuid>69c97586-e36e-45c7-bc68-cf01577b56e1</uuid>
Nov 08 20:42:50 user nova-compute[74638]:   <name>instance-0000002f</name>
Nov 08 20:42:50 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:42:50 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:42:50 user nova-compute[74638]:   <metadata>
Nov 08 20:42:50 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:42:50 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:42:50 user nova-compute[74638]:       <nova:name>tempest-VolumesActionsTest-instance-1094554414</nova:name>
Nov 08 20:42:50 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:42:50</nova:creationTime>
Nov 08 20:42:50 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:42:50 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:42:50 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:42:50 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:42:50 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:42:50 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:42:50 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:42:50 user nova-compute[74638]:       <nova:owner>
Nov 08 20:42:50 user nova-compute[74638]:         <nova:user uuid="6c2f15bfede04cd4a2e447906b5aea01">tempest-VolumesActionsTest-1219331857-project-member</nova:user>
Nov 08 20:42:50 user nova-compute[74638]:         <nova:project uuid="320a8bc7e5964a9c980dcd15768cd558">tempest-VolumesActionsTest-1219331857</nova:project>
Nov 08 20:42:50 user nova-compute[74638]:       </nova:owner>
Nov 08 20:42:50 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:42:50 user nova-compute[74638]:       <nova:ports>
Nov 08 20:42:50 user nova-compute[74638]:         <nova:port uuid="09fcc9f0-5973-4107-af13-08d0ae7d22ee">
Nov 08 20:42:50 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 20:42:50 user nova-compute[74638]:         </nova:port>
Nov 08 20:42:50 user nova-compute[74638]:       </nova:ports>
Nov 08 20:42:50 user nova-compute[74638]:     </nova:instance>
Nov 08 20:42:50 user nova-compute[74638]:   </metadata>
Nov 08 20:42:50 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:42:50 user nova-compute[74638]:     <system>
Nov 08 20:42:50 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:42:50 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:42:50 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:42:50 user nova-compute[74638]:       <entry name="serial">69c97586-e36e-45c7-bc68-cf01577b56e1</entry>
Nov 08 20:42:50 user nova-compute[74638]:       <entry name="uuid">69c97586-e36e-45c7-bc68-cf01577b56e1</entry>
Nov 08 20:42:50 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:42:50 user nova-compute[74638]:     </system>
Nov 08 20:42:50 user nova-compute[74638]:   </sysinfo>
Nov 08 20:42:50 user nova-compute[74638]:   <os>
Nov 08 20:42:50 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:42:50 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:42:50 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:42:50 user nova-compute[74638]:   </os>
Nov 08 20:42:50 user nova-compute[74638]:   <features>
Nov 08 20:42:50 user nova-compute[74638]:     <acpi/>
Nov 08 20:42:50 user nova-compute[74638]:     <apic/>
Nov 08 20:42:50 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:42:50 user nova-compute[74638]:   </features>
Nov 08 20:42:50 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:42:50 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:42:50 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:42:50 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:42:50 user nova-compute[74638]:   </clock>
Nov 08 20:42:50 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:42:50 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:42:50 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:42:50 user nova-compute[74638]:   </cpu>
Nov 08 20:42:50 user nova-compute[74638]:   <devices>
Nov 08 20:42:50 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:42:50 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:42:50 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk"/>
Nov 08 20:42:50 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:42:50 user nova-compute[74638]:     </disk>
Nov 08 20:42:50 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:42:50 user nova-compute[74638]:       <mac address="fa:16:3e:bc:13:c9"/>
Nov 08 20:42:50 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:42:50 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:42:50 user nova-compute[74638]:       <target dev="tap09fcc9f0-59"/>
Nov 08 20:42:50 user nova-compute[74638]:     </interface>
Nov 08 20:42:50 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:42:50 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/console.log" append="off"/>
Nov 08 20:42:50 user nova-compute[74638]:     </serial>
Nov 08 20:42:50 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:42:50 user nova-compute[74638]:     <video>
Nov 08 20:42:50 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:42:50 user nova-compute[74638]:     </video>
Nov 08 20:42:50 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:42:50 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:42:50 user nova-compute[74638]:     </rng>
Nov 08 20:42:50 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:42:50 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:42:50 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:42:50 user nova-compute[74638]:     </memballoon>
Nov 08 20:42:50 user nova-compute[74638]:   </devices>
Nov 08 20:42:50 user nova-compute[74638]: </domain>
Nov 08 20:42:50 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1094554414',display_name='tempest-VolumesActionsTest-instance-1094554414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1094554414',id=47,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='320a8bc7e5964a9c980dcd15768cd558',ramdisk_id='',reservation_id='r-j3iaauft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1219331857',owner_user_name='tempest-VolumesActionsTest-1219331857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:42:49Z,user_data=None,user_id='6c2f15bfede04cd4a2e447906b5aea01',uuid=69c97586-e36e-45c7-bc68-cf01577b56e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Converting VIF {"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=09fcc9f0-5973-4107-af13-08d0ae7d22ee,network=Network(185d228f-e8b4-47be-85d5-350af82d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fcc9f0-59') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG os_vif [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=09fcc9f0-5973-4107-af13-08d0ae7d22ee,network=Network(185d228f-e8b4-47be-85d5-350af82d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fcc9f0-59') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e90e2553-3536-5fb0-a51a-0347bb496ff1', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09fcc9f0-59, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09fcc9f0-59, col_values=(('qos', UUID('c0bbb134-00c1-4988-ab17-19e65632a81f')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09fcc9f0-59, col_values=(('external_ids', {'iface-id': '09fcc9f0-5973-4107-af13-08d0ae7d22ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:13:c9', 'vm-uuid': '69c97586-e36e-45c7-bc68-cf01577b56e1'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:50 user nova-compute[74638]: INFO os_vif [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=09fcc9f0-5973-4107-af13-08d0ae7d22ee,network=Network(185d228f-e8b4-47be-85d5-350af82d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fcc9f0-59')
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] No VIF found with MAC fa:16:3e:bc:13:c9, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.network.neutron [req-e0df9079-d620-4d8b-af65-7af1020042f5 req-706955a6-cbec-4c58-a15f-8d1a32b19b40 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Updated VIF entry in instance network info cache for port 09fcc9f0-5973-4107-af13-08d0ae7d22ee. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG nova.network.neutron [req-e0df9079-d620-4d8b-af65-7af1020042f5 req-706955a6-cbec-4c58-a15f-8d1a32b19b40 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Updating instance_info_cache with network_info: [{"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:42:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e0df9079-d620-4d8b-af65-7af1020042f5 req-706955a6-cbec-4c58-a15f-8d1a32b19b40 service nova] Releasing lock "refresh_cache-69c97586-e36e-45c7-bc68-cf01577b56e1" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:42:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-8778bc9f-2f3f-4d65-945b-f4bbaeeeb301 req-f024b2e1-ad67-4b54-b624-c9a424af0fd7 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received event network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8778bc9f-2f3f-4d65-945b-f4bbaeeeb301 req-f024b2e1-ad67-4b54-b624-c9a424af0fd7 service nova] Acquiring lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8778bc9f-2f3f-4d65-945b-f4bbaeeeb301 req-f024b2e1-ad67-4b54-b624-c9a424af0fd7 service nova] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8778bc9f-2f3f-4d65-945b-f4bbaeeeb301 req-f024b2e1-ad67-4b54-b624-c9a424af0fd7 service nova] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:51 user nova-compute[74638]: DEBUG nova.compute.manager [req-8778bc9f-2f3f-4d65-945b-f4bbaeeeb301 req-f024b2e1-ad67-4b54-b624-c9a424af0fd7 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] No waiting events found dispatching network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:42:51 user nova-compute[74638]: WARNING nova.compute.manager [req-8778bc9f-2f3f-4d65-945b-f4bbaeeeb301 req-f024b2e1-ad67-4b54-b624-c9a424af0fd7 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received unexpected event network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee for instance with vm_state building and task_state spawning.
Nov 08 20:42:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:42:53 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Instance spawned successfully.
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-7bcfe1e9-d5c8-4dd5-90bb-d4f1e6e5afd0 req-4c5fd5dd-533e-4100-b038-0624edaf77b0 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received event network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7bcfe1e9-d5c8-4dd5-90bb-d4f1e6e5afd0 req-4c5fd5dd-533e-4100-b038-0624edaf77b0 service nova] Acquiring lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7bcfe1e9-d5c8-4dd5-90bb-d4f1e6e5afd0 req-4c5fd5dd-533e-4100-b038-0624edaf77b0 service nova] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-7bcfe1e9-d5c8-4dd5-90bb-d4f1e6e5afd0 req-4c5fd5dd-533e-4100-b038-0624edaf77b0 service nova] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-7bcfe1e9-d5c8-4dd5-90bb-d4f1e6e5afd0 req-4c5fd5dd-533e-4100-b038-0624edaf77b0 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] No waiting events found dispatching network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:42:53 user nova-compute[74638]: WARNING nova.compute.manager [req-7bcfe1e9-d5c8-4dd5-90bb-d4f1e6e5afd0 req-4c5fd5dd-533e-4100-b038-0624edaf77b0 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received unexpected event network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee for instance with vm_state building and task_state spawning.
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:42:54 user nova-compute[74638]: INFO nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 08 20:42:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:42:54 user nova-compute[74638]: INFO nova.compute.manager [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Took 6.02 seconds to build instance.
Nov 08 20:42:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-9c3564a7-91c5-4167-a355-bef3d2581b51 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.133s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:42:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:42:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid f228ded5-9ae6-45eb-b81c-e67b294201a4 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 22580a4e-b6c5-466a-911a-7a09e45ee3f3 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 53324df5-af4d-4c77-88e5-ae46854e8214 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid 69c97586-e36e-45c7-bc68-cf01577b56e1 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "69c97586-e36e-45c7-bc68-cf01577b56e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:20 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:21 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:21 user nova-compute[74638]: DEBUG nova.objects.instance [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'flavor' on Instance uuid 22580a4e-b6c5-466a-911a-7a09e45ee3f3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:43:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:21 user nova-compute[74638]: INFO nova.compute.manager [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Attaching volume 3c3e1a41-b438-4d72-a9fd-34971e4ee9db to /dev/vdb
Nov 08 20:43:22 user nova-compute[74638]: DEBUG os_brick.utils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0401e379-a76b-4661-9530-f4c64e2c70ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9550eb-1afa-4b0d-86fe-7220e46c55ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d73f710-f85e-4421-babe-25d86c36c8fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3390657-4b24-4490-9c08-f5ed144f559f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:43:22 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:43:22 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8e97fe-d224-44d9-8650-65ee68764253]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG os_brick.utils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:43:22 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating existing volume attachment record: 3531ed65-a8ba-408c-9872-6a27ee156414 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:43:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:43:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:43:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:43:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:43:24 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:43:24 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid f228ded5-9ae6-45eb-b81c-e67b294201a4 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:43:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updating instance_info_cache with network_info: [{"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:43:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-f228ded5-9ae6-45eb-b81c-e67b294201a4" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:43:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:43:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:43:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:28 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:43:28 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.03949737548828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance f228ded5-9ae6-45eb-b81c-e67b294201a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 53324df5-af4d-4c77-88e5-ae46854e8214 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 69c97586-e36e-45c7-bc68-cf01577b56e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:43:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:43:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:43:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:42 user nova-compute[74638]: INFO nova.compute.manager [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Terminating instance
Nov 08 20:43:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-70d2c3ab-840b-46b4-8af7-7eb025c01771 req-9b4b92f5-97dc-4ae7-bc0f-3e35d9ab18a8 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received event network-vif-unplugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-70d2c3ab-840b-46b4-8af7-7eb025c01771 req-9b4b92f5-97dc-4ae7-bc0f-3e35d9ab18a8 service nova] Acquiring lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-70d2c3ab-840b-46b4-8af7-7eb025c01771 req-9b4b92f5-97dc-4ae7-bc0f-3e35d9ab18a8 service nova] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-70d2c3ab-840b-46b4-8af7-7eb025c01771 req-9b4b92f5-97dc-4ae7-bc0f-3e35d9ab18a8 service nova] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-70d2c3ab-840b-46b4-8af7-7eb025c01771 req-9b4b92f5-97dc-4ae7-bc0f-3e35d9ab18a8 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] No waiting events found dispatching network-vif-unplugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:43:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-70d2c3ab-840b-46b4-8af7-7eb025c01771 req-9b4b92f5-97dc-4ae7-bc0f-3e35d9ab18a8 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received event network-vif-unplugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:43:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Instance destroyed successfully.
Nov 08 20:43:43 user nova-compute[74638]: DEBUG nova.objects.instance [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'resources' on Instance uuid f228ded5-9ae6-45eb-b81c-e67b294201a4 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:38:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1491425149',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1491425149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1491425149',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRJvFY0nAWFZHpvInv/qhc/9i8r4K8jkeHcUXJvvu6bVu3KDLeb8myrCgL+e04M+zauBw0Z9V1SEVyMK2/hSjgwpPD2Hk0ALiirD7DAOw9e0cOnAkWstsixCHMsdrQHVA==',key_name='tempest-keypair-1125324791',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-efjun1c4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=f228ded5-9ae6-45eb-b81c-e67b294201a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "address": "fa:16:3e:54:31:96", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8f08084-31", "ovs_interfaceid": "d8f08084-31a6-4192-8e38-4b5e66d497a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:31:96,bridge_name='br-int',has_traffic_filtering=True,id=d8f08084-31a6-4192-8e38-4b5e66d497a6,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f08084-31') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_vif [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:31:96,bridge_name='br-int',has_traffic_filtering=True,id=d8f08084-31a6-4192-8e38-4b5e66d497a6,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f08084-31') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8f08084-31, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3192211f-db22-42dc-a89c-f941040c3bcc) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:43:43 user nova-compute[74638]: INFO os_vif [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:31:96,bridge_name='br-int',has_traffic_filtering=True,id=d8f08084-31a6-4192-8e38-4b5e66d497a6,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8f08084-31')
Nov 08 20:43:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDrnFigY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:43:43 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3185ae-fe92-4074-9d18-0e66aefa0c88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:43:43 user nova-compute[74638]: No targets found.
Nov 08 20:43:43 user nova-compute[74638]: iSNS:
Nov 08 20:43:43 user nova-compute[74638]: No targets found.
Nov 08 20:43:43 user nova-compute[74638]: STATIC:
Nov 08 20:43:43 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310
Nov 08 20:43:43 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:43:43 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:43:43 user nova-compute[74638]: FIRMWARE:
Nov 08 20:43:43 user nova-compute[74638]: No targets found.
Nov 08 20:43:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:43:43 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:43:43 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5b9dd-c995-498f-b776-77411a5873ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aa9ed2-11ea-417d-85da-b9d227c187e9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:43:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 (non-flash)
Nov 08 20:43:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c4957e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab38fbf-cfe1-467d-ad79-3523657ca3fe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[27536a7f-fc59-4d1b-894e-b68ee58b870a]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd33517-c05a-4717-94cc-cf866d380e5d]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[58290f87-2a65-4e36-a795-b08de7451d24]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26535316239396464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1d1cb76e', '/dev/disk/by-id/scsi-1SCST_BIO1d1cb76e-e51b99dd597967e5') {{(pid=85977) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7985a14-6bf4-42de-9262-c4f67f0e8cfc]: (4, None) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df0728a-511f-49c9-9d98-4a07b6788b4e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[877c0b95-c881-435d-a8e4-f6f681b3028e]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310, portal: 172.16.0.220,3260]
Nov 08 20:43:43 user nova-compute[74638]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310, portal: 172.16.0.220,3260] successful.
Nov 08 20:43:43 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e34c52c5-83eb-40e5-aa3d-922ab93a9310 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd27e9-0d5a-4a90-b2f3-e683babe2e99]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== disconnect_volume: return (303ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:43:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Deleting instance files /opt/stack/data/nova/instances/f228ded5-9ae6-45eb-b81c-e67b294201a4_del
Nov 08 20:43:43 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Deletion of /opt/stack/data/nova/instances/f228ded5-9ae6-45eb-b81c-e67b294201a4_del complete
Nov 08 20:43:43 user nova-compute[74638]: INFO nova.compute.manager [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 08 20:43:43 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:43:43 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:43:44 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:43:44 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Took 0.98 seconds to deallocate network for instance.
Nov 08 20:43:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-58501e93-5b09-4c03-9803-4c37b2300e5e req-55a75689-ccdd-4ea2-85c6-4251c1167422 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received event network-vif-deleted-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:43:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-8163c5e8-0a64-4e99-8822-8223071e72ab req-e43fc0a7-f84d-4a5c-86b7-5d9f9502f172 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received event network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:43:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8163c5e8-0a64-4e99-8822-8223071e72ab req-e43fc0a7-f84d-4a5c-86b7-5d9f9502f172 service nova] Acquiring lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8163c5e8-0a64-4e99-8822-8223071e72ab req-e43fc0a7-f84d-4a5c-86b7-5d9f9502f172 service nova] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8163c5e8-0a64-4e99-8822-8223071e72ab req-e43fc0a7-f84d-4a5c-86b7-5d9f9502f172 service nova] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-8163c5e8-0a64-4e99-8822-8223071e72ab req-e43fc0a7-f84d-4a5c-86b7-5d9f9502f172 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] No waiting events found dispatching network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:43:44 user nova-compute[74638]: WARNING nova.compute.manager [req-8163c5e8-0a64-4e99-8822-8223071e72ab req-e43fc0a7-f84d-4a5c-86b7-5d9f9502f172 service nova] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Received unexpected event network-vif-plugged-d8f08084-31a6-4192-8e38-4b5e66d497a6 for instance with vm_state active and task_state deleting.
Nov 08 20:43:45 user nova-compute[74638]: INFO nova.compute.manager [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Took 1.03 seconds to detach 1 volumes for instance.
Nov 08 20:43:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: f228ded5-9ae6-45eb-b81c-e67b294201a4] Deleting volume: e34c52c5-83eb-40e5-aa3d-922ab93a9310 {{(pid=74638) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 20:43:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:43:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:43:45 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:43:45 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:43:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:45 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Deleted allocations for instance f228ded5-9ae6-45eb-b81c-e67b294201a4
Nov 08 20:43:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-aa0deb23-9f60-4a42-9c7e-4d28061e5235 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "f228ded5-9ae6-45eb-b81c-e67b294201a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.694s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhpaRrvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:43:54 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:43:54 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:43:54 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa7874c-5479-4207-909a-112ae7da3cd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:43:54 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba810e0-d234-4a1f-83ef-7d9d631b9f2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db] added
Nov 08 20:43:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[352cfee1-0a06-43ea-a356-47d3fa85dbe6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[88abd93f-dfdd-4457-bf57-d6a324dff8ab]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yhpaRrvS {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yhpaRrvS" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[da934773-53cb-44c7-bd9f-99fbfe7b5547]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yhpaRrvS'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713d1a9-cc65-4942-9f57-68f44d53e212]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf6ce48-ba67-4ed5-b104-7711767c5737]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:43:54 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:43:54 user nova-compute[74638]:  {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:43:54 user nova-compute[74638]: WARNING os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 20:43:54 user nova-compute[74638]: 
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba952e31-2b60-4c6c-a0d5-1fb400120c9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db, portal: 172.16.0.220,3260]
Nov 08 20:43:54 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db, portal: 172.16.0.220,3260] successful.
Nov 08 20:43:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc14a6b2-350a-4b31-a3eb-db30f6b0baa8]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec89876-7b12-4df7-8e7c-f5f4ffb177a9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:43:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:43:54 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[011986a7-8489-444c-b505-5c188ada6269]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:43:54 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhpaRrvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26231343433346564', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231343433346564', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG nova.objects.instance [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'flavor' on Instance uuid 22580a4e-b6c5-466a-911a-7a09e45ee3f3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:43:55 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:43:55 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:43:55 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:43:55 user nova-compute[74638]:   <serial>3c3e1a41-b438-4d72-a9fd-34971e4ee9db</serial>
Nov 08 20:43:55 user nova-compute[74638]: </disk>
Nov 08 20:43:55 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:43:55 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] No VIF found with MAC fa:16:3e:51:9a:a5, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:43:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-81d0fce0-e045-4bd0-ae88-2377e62c7b5b tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.099s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-014ae57e-f6c7-4959-92c8-d737e295bf74 req-66ba8729-f720-4113-97f6-d3011445cba0 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-014ae57e-f6c7-4959-92c8-d737e295bf74 req-66ba8729-f720-4113-97f6-d3011445cba0 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing instance network info cache due to event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-014ae57e-f6c7-4959-92c8-d737e295bf74 req-66ba8729-f720-4113-97f6-d3011445cba0 service nova] Acquiring lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-014ae57e-f6c7-4959-92c8-d737e295bf74 req-66ba8729-f720-4113-97f6-d3011445cba0 service nova] Acquired lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG nova.network.neutron [req-014ae57e-f6c7-4959-92c8-d737e295bf74 req-66ba8729-f720-4113-97f6-d3011445cba0 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG nova.network.neutron [req-014ae57e-f6c7-4959-92c8-d737e295bf74 req-66ba8729-f720-4113-97f6-d3011445cba0 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updated VIF entry in instance network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG nova.network.neutron [req-014ae57e-f6c7-4959-92c8-d737e295bf74 req-66ba8729-f720-4113-97f6-d3011445cba0 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:43:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-014ae57e-f6c7-4959-92c8-d737e295bf74 req-66ba8729-f720-4113-97f6-d3011445cba0 service nova] Releasing lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:43:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-caf4c19f-12bd-4b3d-9340-8d99fb0dc21d req-0e45ebf9-17bc-499a-a15e-a094a3f973d7 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:44:00 user nova-compute[74638]: DEBUG nova.compute.manager [req-caf4c19f-12bd-4b3d-9340-8d99fb0dc21d req-0e45ebf9-17bc-499a-a15e-a094a3f973d7 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing instance network info cache due to event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:44:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-caf4c19f-12bd-4b3d-9340-8d99fb0dc21d req-0e45ebf9-17bc-499a-a15e-a094a3f973d7 service nova] Acquiring lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:44:00 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-caf4c19f-12bd-4b3d-9340-8d99fb0dc21d req-0e45ebf9-17bc-499a-a15e-a094a3f973d7 service nova] Acquired lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:44:00 user nova-compute[74638]: DEBUG nova.network.neutron [req-caf4c19f-12bd-4b3d-9340-8d99fb0dc21d req-0e45ebf9-17bc-499a-a15e-a094a3f973d7 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG nova.network.neutron [req-caf4c19f-12bd-4b3d-9340-8d99fb0dc21d req-0e45ebf9-17bc-499a-a15e-a094a3f973d7 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updated VIF entry in instance network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG nova.network.neutron [req-caf4c19f-12bd-4b3d-9340-8d99fb0dc21d req-0e45ebf9-17bc-499a-a15e-a094a3f973d7 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-caf4c19f-12bd-4b3d-9340-8d99fb0dc21d req-0e45ebf9-17bc-499a-a15e-a094a3f973d7 service nova] Releasing lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:01 user nova-compute[74638]: INFO nova.compute.manager [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Rebooting instance
Nov 08 20:44:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquired lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG nova.network.neutron [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Releasing lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:44:01 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:44:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-72776875-75a4-4ef3-b972-51e5778934a8 req-2a652741-2989-48b7-b3a6-ea4778aa48b3 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-unplugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-72776875-75a4-4ef3-b972-51e5778934a8 req-2a652741-2989-48b7-b3a6-ea4778aa48b3 service nova] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-72776875-75a4-4ef3-b972-51e5778934a8 req-2a652741-2989-48b7-b3a6-ea4778aa48b3 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-72776875-75a4-4ef3-b972-51e5778934a8 req-2a652741-2989-48b7-b3a6-ea4778aa48b3 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:04 user nova-compute[74638]: DEBUG nova.compute.manager [req-72776875-75a4-4ef3-b972-51e5778934a8 req-2a652741-2989-48b7-b3a6-ea4778aa48b3 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] No waiting events found dispatching network-vif-unplugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:44:04 user nova-compute[74638]: WARNING nova.compute.manager [req-72776875-75a4-4ef3-b972-51e5778934a8 req-2a652741-2989-48b7-b3a6-ea4778aa48b3 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received unexpected event network-vif-unplugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 for instance with vm_state active and task_state reboot_started.
Nov 08 20:44:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance shutdown successfully.
Nov 08 20:44:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-64fa054a-e5aa-4969-bc41-4bded827916c req-35d8c204-3ff6-47d3-9751-64e5f51250a4 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64fa054a-e5aa-4969-bc41-4bded827916c req-35d8c204-3ff6-47d3-9751-64e5f51250a4 service nova] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64fa054a-e5aa-4969-bc41-4bded827916c req-35d8c204-3ff6-47d3-9751-64e5f51250a4 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-64fa054a-e5aa-4969-bc41-4bded827916c req-35d8c204-3ff6-47d3-9751-64e5f51250a4 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-64fa054a-e5aa-4969-bc41-4bded827916c req-35d8c204-3ff6-47d3-9751-64e5f51250a4 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] No waiting events found dispatching network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:44:06 user nova-compute[74638]: WARNING nova.compute.manager [req-64fa054a-e5aa-4969-bc41-4bded827916c req-35d8c204-3ff6-47d3-9751-64e5f51250a4 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received unexpected event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 for instance with vm_state active and task_state reboot_started.
Nov 08 20:44:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:08 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance running successfully.
Nov 08 20:44:08 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance soft rebooted successfully.
Nov 08 20:44:08 user nova-compute[74638]: DEBUG nova.compute.manager [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4cda687-1389-42f4-96d4-a8b248d1e020 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.113s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] No waiting events found dispatching network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:44:08 user nova-compute[74638]: WARNING nova.compute.manager [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received unexpected event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 for instance with vm_state active and task_state None.
Nov 08 20:44:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] No waiting events found dispatching network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:44:08 user nova-compute[74638]: WARNING nova.compute.manager [req-9297efbe-019e-463d-832b-65bbdb00e158 req-c9e19d31-ea7b-498a-8f39-3f2425962e27 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received unexpected event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 for instance with vm_state active and task_state None.
Nov 08 20:44:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:18 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:21 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:23 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:23 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:24 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:44:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:44:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:44:25 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:44:25 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:27 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:28 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:44:28 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8590MB free_disk=25.036602020263672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 53324df5-af4d-4c77-88e5-ae46854e8214 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 69c97586-e36e-45c7-bc68-cf01577b56e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:44:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-d4577974-788a-4516-8f03-4bbe55dc386b req-2d6db422-611e-4a14-94c8-8c07a20e9d36 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received event network-changed-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG nova.compute.manager [req-d4577974-788a-4516-8f03-4bbe55dc386b req-2d6db422-611e-4a14-94c8-8c07a20e9d36 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Refreshing instance network info cache due to event network-changed-07ff1024-998d-4046-b513-4ac17e1014bc. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d4577974-788a-4516-8f03-4bbe55dc386b req-2d6db422-611e-4a14-94c8-8c07a20e9d36 service nova] Acquiring lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d4577974-788a-4516-8f03-4bbe55dc386b req-2d6db422-611e-4a14-94c8-8c07a20e9d36 service nova] Acquired lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-d4577974-788a-4516-8f03-4bbe55dc386b req-2d6db422-611e-4a14-94c8-8c07a20e9d36 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Refreshing network info cache for port 07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-d4577974-788a-4516-8f03-4bbe55dc386b req-2d6db422-611e-4a14-94c8-8c07a20e9d36 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updated VIF entry in instance network info cache for port 07ff1024-998d-4046-b513-4ac17e1014bc. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG nova.network.neutron [req-d4577974-788a-4516-8f03-4bbe55dc386b req-2d6db422-611e-4a14-94c8-8c07a20e9d36 service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updating instance_info_cache with network_info: [{"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:44:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d4577974-788a-4516-8f03-4bbe55dc386b req-2d6db422-611e-4a14-94c8-8c07a20e9d36 service nova] Releasing lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:44:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:31 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid 53324df5-af4d-4c77-88e5-ae46854e8214 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:35 user nova-compute[74638]: INFO nova.compute.manager [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Attaching volume b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 to /dev/vdb
Nov 08 20:44:35 user nova-compute[74638]: DEBUG os_brick.utils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56536f9-570c-4251-98b2-05c0cbd77b80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd0e4cf-aa54-49ab-b1c5-cb5c5cf7d74b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3318c9-58d8-4028-880a-d8efcc1af453]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2336f5c-ac92-4ce8-b039-3df189b52d95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:44:35 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:44:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec640ad-6b50-4e5f-aea2-6e0448aaa03a]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG os_brick.utils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:44:35 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updating existing volume attachment record: 877c3378-bc8c-4708-ba68-9c55ab0c160b {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:44:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:43 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "a663db7f-2354-4802-820c-948377d0cc72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a663db7f-2354-4802-820c-948377d0cc72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:44:53 user nova-compute[74638]: INFO nova.compute.claims [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Claim successful on node user
Nov 08 20:44:53 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:44:53 user nova-compute[74638]: DEBUG nova.network.neutron [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:44:53 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:44:54 user nova-compute[74638]: DEBUG nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG nova.policy [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63d3b55213f44fbb4dd76758a9a61ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e599a20be834415ea60230b8743a2338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:44:54 user nova-compute[74638]: INFO nova.virt.block_device [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Booting with volume 9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 at /dev/vda
Nov 08 20:44:54 user nova-compute[74638]: DEBUG os_brick.utils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8cc8cf-1514-44d3-965a-652766251b75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b7399-e23f-4683-a269-c2d067a08f3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c033df-b78b-419e-9c8e-b88b3d2267b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0714e07-3795-4af6-aacf-9593bb9acc34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:44:54 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:44:54 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dc8415-65d3-437c-84b6-e02745d869d2]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG os_brick.utils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:44:54 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Updating existing volume attachment record: 61460e11-20a5-4110-8948-26754a2c3987 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Successfully created port: 1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Successfully updated port: 1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquired lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-9fdd71f8-3b2e-40a1-9332-9dfe7d1e8880 req-fa8c386c-673f-4c1f-a0b8-49c61b7065f2 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received event network-changed-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG nova.compute.manager [req-9fdd71f8-3b2e-40a1-9332-9dfe7d1e8880 req-fa8c386c-673f-4c1f-a0b8-49c61b7065f2 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Refreshing instance network info cache due to event network-changed-1b18b2c3-8abc-4906-9faa-2497bd894580. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9fdd71f8-3b2e-40a1-9332-9dfe7d1e8880 req-fa8c386c-673f-4c1f-a0b8-49c61b7065f2 service nova] Acquiring lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:44:55 user nova-compute[74638]: DEBUG nova.network.neutron [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:44:56 user nova-compute[74638]: DEBUG nova.network.neutron [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Updating instance_info_cache with network_info: [{"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:44:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Releasing lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:44:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Instance network_info: |[{"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:44:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9fdd71f8-3b2e-40a1-9332-9dfe7d1e8880 req-fa8c386c-673f-4c1f-a0b8-49c61b7065f2 service nova] Acquired lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:44:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-9fdd71f8-3b2e-40a1-9332-9dfe7d1e8880 req-fa8c386c-673f-4c1f-a0b8-49c61b7065f2 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Refreshing network info cache for port 1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:44:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-9fdd71f8-3b2e-40a1-9332-9dfe7d1e8880 req-fa8c386c-673f-4c1f-a0b8-49c61b7065f2 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Updated VIF entry in instance network info cache for port 1b18b2c3-8abc-4906-9faa-2497bd894580. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:44:56 user nova-compute[74638]: DEBUG nova.network.neutron [req-9fdd71f8-3b2e-40a1-9332-9dfe7d1e8880 req-fa8c386c-673f-4c1f-a0b8-49c61b7065f2 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Updating instance_info_cache with network_info: [{"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:44:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-9fdd71f8-3b2e-40a1-9332-9dfe7d1e8880 req-fa8c386c-673f-4c1f-a0b8-49c61b7065f2 service nova] Releasing lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:44:58 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXMUYEKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:45:03 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:45:03 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:45:03 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4714fb-2381-4437-af43-f8ca4dc57168]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:45:03 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[162708d3-b1e1-4b60-a5a1-6042580c77cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2] added
Nov 08 20:45:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf438e0-cc08-4757-a4ea-1b107d74252a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdb32f6-4e83-4c63-9a38-e9fd20bd5738]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXMUYEKc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXMUYEKc" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88c9a1c-2cff-4219-b646-66c27a83919b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXMUYEKc'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34fe3f-dfe7-48fe-9b60-66e1b4f8c5f6]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[504beea6-8f9b-4fd5-9d37-458d3a7eaa64]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68a5fa-051f-407d-bd7d-41126290ea03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2, portal: 172.16.0.220,3260]
Nov 08 20:45:03 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2, portal: 172.16.0.220,3260] successful.
Nov 08 20:45:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6234662e-7384-4157-a41e-9acb321c4e02]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148a5f0-a092-402a-a38a-72374e992c59]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:03 user nova-compute[74638]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)
Nov 08 20:45:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:03 user nova-compute[74638]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)
Nov 08 20:45:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad0a14b-4e8d-40c8-985c-228335735abf]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:45:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXMUYEKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26139343164656631', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139343164656631', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG nova.objects.instance [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid 53324df5-af4d-4c77-88e5-ae46854e8214 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:45:04 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:45:04 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:45:04 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:45:04 user nova-compute[74638]:   <serial>b453d2a3-f17d-4a4c-98ca-057ed84e0cb2</serial>
Nov 08 20:45:04 user nova-compute[74638]: </disk>
Nov 08 20:45:04 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:45:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No VIF found with MAC fa:16:3e:2e:69:d7, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:45:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-bb4c568c-2838-4420-b41a-833096f32f1b tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.676s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:05 user nova-compute[74638]: INFO nova.compute.manager [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Detaching volume b453d2a3-f17d-4a4c-98ca-057ed84e0cb2
Nov 08 20:45:05 user nova-compute[74638]: INFO nova.virt.block_device [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Attempting to driver detach volume b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 from mountpoint /dev/vdb
Nov 08 20:45:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Attempting to detach device vdb from instance 53324df5-af4d-4c77-88e5-ae46854e8214 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:45:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:45:05 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:45:05 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:45:05 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:45:05 user nova-compute[74638]:   <serial>b453d2a3-f17d-4a4c-98ca-057ed84e0cb2</serial>
Nov 08 20:45:05 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:45:05 user nova-compute[74638]: </disk>
Nov 08 20:45:05 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:45:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully detached device vdb from instance 53324df5-af4d-4c77-88e5-ae46854e8214 from the persistent domain config.
Nov 08 20:45:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53324df5-af4d-4c77-88e5-ae46854e8214 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:45:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:45:05 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:45:05 user nova-compute[74638]:   <source dev="/dev/sdc"/>
Nov 08 20:45:05 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:45:05 user nova-compute[74638]:   <serial>b453d2a3-f17d-4a4c-98ca-057ed84e0cb2</serial>
Nov 08 20:45:05 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:45:05 user nova-compute[74638]: </disk>
Nov 08 20:45:05 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:45:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53324df5-af4d-4c77-88e5-ae46854e8214 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:45:08 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:45:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:45:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:45:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:45:13 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "69c97586-e36e-45c7-bc68-cf01577b56e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:15 user nova-compute[74638]: INFO nova.compute.manager [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Terminating instance
Nov 08 20:45:15 user nova-compute[74638]: DEBUG nova.compute.manager [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-efa9d702-4154-4cb6-af2b-8360e37af955 req-cbffbecc-04de-49be-938f-f3e4b268e242 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received event network-vif-unplugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-efa9d702-4154-4cb6-af2b-8360e37af955 req-cbffbecc-04de-49be-938f-f3e4b268e242 service nova] Acquiring lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-efa9d702-4154-4cb6-af2b-8360e37af955 req-cbffbecc-04de-49be-938f-f3e4b268e242 service nova] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-efa9d702-4154-4cb6-af2b-8360e37af955 req-cbffbecc-04de-49be-938f-f3e4b268e242 service nova] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-efa9d702-4154-4cb6-af2b-8360e37af955 req-cbffbecc-04de-49be-938f-f3e4b268e242 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] No waiting events found dispatching network-vif-unplugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG nova.compute.manager [req-efa9d702-4154-4cb6-af2b-8360e37af955 req-cbffbecc-04de-49be-938f-f3e4b268e242 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received event network-vif-unplugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:45:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Instance destroyed successfully.
Nov 08 20:45:15 user nova-compute[74638]: DEBUG nova.objects.instance [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lazy-loading 'resources' on Instance uuid 69c97586-e36e-45c7-bc68-cf01577b56e1 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1094554414',display_name='tempest-VolumesActionsTest-instance-1094554414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1094554414',id=47,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:42:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='320a8bc7e5964a9c980dcd15768cd558',ramdisk_id='',reservation_id='r-j3iaauft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1219331857',owner_user_name='tempest-VolumesActionsTest-1219331857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:42:54Z,user_data=None,user_id='6c2f15bfede04cd4a2e447906b5aea01',uuid=69c97586-e36e-45c7-bc68-cf01577b56e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Converting VIF {"id": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "address": "fa:16:3e:bc:13:c9", "network": {"id": "185d228f-e8b4-47be-85d5-350af82d3040", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1526324091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "320a8bc7e5964a9c980dcd15768cd558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09fcc9f0-59", "ovs_interfaceid": "09fcc9f0-5973-4107-af13-08d0ae7d22ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=09fcc9f0-5973-4107-af13-08d0ae7d22ee,network=Network(185d228f-e8b4-47be-85d5-350af82d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fcc9f0-59') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG os_vif [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=09fcc9f0-5973-4107-af13-08d0ae7d22ee,network=Network(185d228f-e8b4-47be-85d5-350af82d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fcc9f0-59') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09fcc9f0-59, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:45:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0bbb134-00c1-4988-ab17-19e65632a81f) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:16 user nova-compute[74638]: INFO os_vif [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=09fcc9f0-5973-4107-af13-08d0ae7d22ee,network=Network(185d228f-e8b4-47be-85d5-350af82d3040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09fcc9f0-59')
Nov 08 20:45:16 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Deleting instance files /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1_del
Nov 08 20:45:16 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Deletion of /opt/stack/data/nova/instances/69c97586-e36e-45c7-bc68-cf01577b56e1_del complete
Nov 08 20:45:16 user nova-compute[74638]: INFO nova.compute.manager [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 08 20:45:16 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:45:16 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Took 0.45 seconds to deallocate network for instance.
Nov 08 20:45:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d15818-57df-4c72-8c51-6f7dea5c0bd5 req-68176919-a775-47c2-84f1-d381418c5062 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received event network-vif-deleted-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:16 user nova-compute[74638]: INFO nova.compute.manager [req-e9d15818-57df-4c72-8c51-6f7dea5c0bd5 req-68176919-a775-47c2-84f1-d381418c5062 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Neutron deleted interface 09fcc9f0-5973-4107-af13-08d0ae7d22ee; detaching it from the instance and deleting it from the info cache
Nov 08 20:45:16 user nova-compute[74638]: DEBUG nova.network.neutron [req-e9d15818-57df-4c72-8c51-6f7dea5c0bd5 req-68176919-a775-47c2-84f1-d381418c5062 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d15818-57df-4c72-8c51-6f7dea5c0bd5 req-68176919-a775-47c2-84f1-d381418c5062 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Detach interface failed, port_id=09fcc9f0-5973-4107-af13-08d0ae7d22ee, reason: Instance 69c97586-e36e-45c7-bc68-cf01577b56e1 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:45:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:16 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Deleted allocations for instance 69c97586-e36e-45c7-bc68-cf01577b56e1
Nov 08 20:45:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-efb13335-3bc6-47d6-9085-85020bfc2f30 tempest-VolumesActionsTest-1219331857 tempest-VolumesActionsTest-1219331857-project-member] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.598s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-d142ee1a-c42d-4bd1-9f1b-98c7a9936b1c req-56f90f78-6339-42ff-92a9-a0dd398e54a0 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received event network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d142ee1a-c42d-4bd1-9f1b-98c7a9936b1c req-56f90f78-6339-42ff-92a9-a0dd398e54a0 service nova] Acquiring lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d142ee1a-c42d-4bd1-9f1b-98c7a9936b1c req-56f90f78-6339-42ff-92a9-a0dd398e54a0 service nova] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d142ee1a-c42d-4bd1-9f1b-98c7a9936b1c req-56f90f78-6339-42ff-92a9-a0dd398e54a0 service nova] Lock "69c97586-e36e-45c7-bc68-cf01577b56e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.compute.manager [req-d142ee1a-c42d-4bd1-9f1b-98c7a9936b1c req-56f90f78-6339-42ff-92a9-a0dd398e54a0 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] No waiting events found dispatching network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:45:17 user nova-compute[74638]: WARNING nova.compute.manager [req-d142ee1a-c42d-4bd1-9f1b-98c7a9936b1c req-56f90f78-6339-42ff-92a9-a0dd398e54a0 service nova] [instance: 69c97586-e36e-45c7-bc68-cf01577b56e1] Received unexpected event network-vif-plugged-09fcc9f0-5973-4107-af13-08d0ae7d22ee for instance with vm_state deleted and task_state None.
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:45:17 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Creating image(s)
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Ensure instance console log exists: /opt/stack/data/nova/instances/a663db7f-2354-4802-820c-948377d0cc72/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Start _get_guest_xml network_info=[{"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '61460e11-20a5-4110-8948-26754a2c3987', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaZhkXFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a663db7f-2354-4802-820c-948377d0cc72', 'attached_at': '', 'detached_at': '', 'volume_id': '9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'serial': '9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:45:17 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:45:17 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:45:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaZhkXFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:45:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:45:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:45:18 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdbe346-c3db-46db-89c3-51363053c9b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:45:18 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[88083983-370f-4a6c-8186-f35a8b002a00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56] added
Nov 08 20:45:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70417f8-c7b3-4065-8f5d-10a7f25e0f6b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fd214d-efc9-4db0-925f-5b6feb6b907a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PaZhkXFE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PaZhkXFE" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a8fbe-f2ec-4599-a594-24939761b997]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PaZhkXFE'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ea9e9f-9f2d-4471-8465-7ef178e0316f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef76c6d-aed5-4f0c-bf8e-a366140be572]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:18 user nova-compute[74638]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)
Nov 08 20:45:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:18 user nova-compute[74638]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)
Nov 08 20:45:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad93cba-b39b-49eb-b5fa-032c76607c67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260]
Nov 08 20:45:18 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260] successful.
Nov 08 20:45:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ec4d4e-5f3a-490b-94af-e5ece2bc80f7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6348b-4c45-4639-a07d-0fc50e0ff791]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:18 user nova-compute[74638]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)
Nov 08 20:45:18 user nova-compute[74638]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:45:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:18 user nova-compute[74638]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)
Nov 08 20:45:18 user nova-compute[74638]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:45:18 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca844f6b-fdcc-412a-a620-c82019972eeb]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:18 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaZhkXFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26533306663303936', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533306663303936', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1944614699',display_name='tempest-TestVolumeBootPattern-server-1944614699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1944614699',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-gqhy40i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:44:54Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=a663db7f-2354-4802-820c-948377d0cc72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:0d:e7,bridge_name='br-int',has_traffic_filtering=True,id=1b18b2c3-8abc-4906-9faa-2497bd894580,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b18b2c3-8a') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.objects.instance [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'pci_devices' on Instance uuid a663db7f-2354-4802-820c-948377d0cc72 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:45:19 user nova-compute[74638]:   <uuid>a663db7f-2354-4802-820c-948377d0cc72</uuid>
Nov 08 20:45:19 user nova-compute[74638]:   <name>instance-00000030</name>
Nov 08 20:45:19 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:45:19 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:45:19 user nova-compute[74638]:   <metadata>
Nov 08 20:45:19 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:45:19 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:45:19 user nova-compute[74638]:       <nova:name>tempest-TestVolumeBootPattern-server-1944614699</nova:name>
Nov 08 20:45:19 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:45:17</nova:creationTime>
Nov 08 20:45:19 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:45:19 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:45:19 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:45:19 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:45:19 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:45:19 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:45:19 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:45:19 user nova-compute[74638]:       <nova:owner>
Nov 08 20:45:19 user nova-compute[74638]:         <nova:user uuid="f63d3b55213f44fbb4dd76758a9a61ed">tempest-TestVolumeBootPattern-1116596406-project-member</nova:user>
Nov 08 20:45:19 user nova-compute[74638]:         <nova:project uuid="e599a20be834415ea60230b8743a2338">tempest-TestVolumeBootPattern-1116596406</nova:project>
Nov 08 20:45:19 user nova-compute[74638]:       </nova:owner>
Nov 08 20:45:19 user nova-compute[74638]:       <nova:ports>
Nov 08 20:45:19 user nova-compute[74638]:         <nova:port uuid="1b18b2c3-8abc-4906-9faa-2497bd894580">
Nov 08 20:45:19 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 20:45:19 user nova-compute[74638]:         </nova:port>
Nov 08 20:45:19 user nova-compute[74638]:       </nova:ports>
Nov 08 20:45:19 user nova-compute[74638]:     </nova:instance>
Nov 08 20:45:19 user nova-compute[74638]:   </metadata>
Nov 08 20:45:19 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:45:19 user nova-compute[74638]:     <system>
Nov 08 20:45:19 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:45:19 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:45:19 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:45:19 user nova-compute[74638]:       <entry name="serial">a663db7f-2354-4802-820c-948377d0cc72</entry>
Nov 08 20:45:19 user nova-compute[74638]:       <entry name="uuid">a663db7f-2354-4802-820c-948377d0cc72</entry>
Nov 08 20:45:19 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:45:19 user nova-compute[74638]:     </system>
Nov 08 20:45:19 user nova-compute[74638]:   </sysinfo>
Nov 08 20:45:19 user nova-compute[74638]:   <os>
Nov 08 20:45:19 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:45:19 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:45:19 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:45:19 user nova-compute[74638]:   </os>
Nov 08 20:45:19 user nova-compute[74638]:   <features>
Nov 08 20:45:19 user nova-compute[74638]:     <acpi/>
Nov 08 20:45:19 user nova-compute[74638]:     <apic/>
Nov 08 20:45:19 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:45:19 user nova-compute[74638]:   </features>
Nov 08 20:45:19 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:45:19 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:45:19 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:45:19 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:45:19 user nova-compute[74638]:   </clock>
Nov 08 20:45:19 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:45:19 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:45:19 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:45:19 user nova-compute[74638]:   </cpu>
Nov 08 20:45:19 user nova-compute[74638]:   <devices>
Nov 08 20:45:19 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:45:19 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:45:19 user nova-compute[74638]:       <source dev="/dev/sdd"/>
Nov 08 20:45:19 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:45:19 user nova-compute[74638]:       <serial>9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56</serial>
Nov 08 20:45:19 user nova-compute[74638]:     </disk>
Nov 08 20:45:19 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:45:19 user nova-compute[74638]:       <mac address="fa:16:3e:ae:0d:e7"/>
Nov 08 20:45:19 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:45:19 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:45:19 user nova-compute[74638]:       <target dev="tap1b18b2c3-8a"/>
Nov 08 20:45:19 user nova-compute[74638]:     </interface>
Nov 08 20:45:19 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:45:19 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/a663db7f-2354-4802-820c-948377d0cc72/console.log" append="off"/>
Nov 08 20:45:19 user nova-compute[74638]:     </serial>
Nov 08 20:45:19 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:45:19 user nova-compute[74638]:     <video>
Nov 08 20:45:19 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:45:19 user nova-compute[74638]:     </video>
Nov 08 20:45:19 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:45:19 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:45:19 user nova-compute[74638]:     </rng>
Nov 08 20:45:19 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:45:19 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:45:19 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:45:19 user nova-compute[74638]:     </memballoon>
Nov 08 20:45:19 user nova-compute[74638]:   </devices>
Nov 08 20:45:19 user nova-compute[74638]: </domain>
Nov 08 20:45:19 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1944614699',display_name='tempest-TestVolumeBootPattern-server-1944614699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1944614699',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-gqhy40i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:44:54Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=a663db7f-2354-4802-820c-948377d0cc72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:0d:e7,bridge_name='br-int',has_traffic_filtering=True,id=1b18b2c3-8abc-4906-9faa-2497bd894580,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b18b2c3-8a') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG os_vif [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:0d:e7,bridge_name='br-int',has_traffic_filtering=True,id=1b18b2c3-8abc-4906-9faa-2497bd894580,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b18b2c3-8a') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b07f390-8af4-5fa5-8352-f81a5cd164e6', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b18b2c3-8a, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b18b2c3-8a, col_values=(('qos', UUID('34d38ffe-97ff-46c0-99a6-dcca3b3f8bb3')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b18b2c3-8a, col_values=(('external_ids', {'iface-id': '1b18b2c3-8abc-4906-9faa-2497bd894580', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:0d:e7', 'vm-uuid': 'a663db7f-2354-4802-820c-948377d0cc72'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:19 user nova-compute[74638]: INFO os_vif [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:0d:e7,bridge_name='br-int',has_traffic_filtering=True,id=1b18b2c3-8abc-4906-9faa-2497bd894580,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b18b2c3-8a')
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:45:19 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No VIF found with MAC fa:16:3e:ae:0d:e7, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:45:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-0d357169-0e36-4084-9330-ee413ab6db4b req-e318e4d9-271a-4b48-b5a4-8e5bd2e33ed7 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received event network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d357169-0e36-4084-9330-ee413ab6db4b req-e318e4d9-271a-4b48-b5a4-8e5bd2e33ed7 service nova] Acquiring lock "a663db7f-2354-4802-820c-948377d0cc72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d357169-0e36-4084-9330-ee413ab6db4b req-e318e4d9-271a-4b48-b5a4-8e5bd2e33ed7 service nova] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:20 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0d357169-0e36-4084-9330-ee413ab6db4b req-e318e4d9-271a-4b48-b5a4-8e5bd2e33ed7 service nova] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:20 user nova-compute[74638]: DEBUG nova.compute.manager [req-0d357169-0e36-4084-9330-ee413ab6db4b req-e318e4d9-271a-4b48-b5a4-8e5bd2e33ed7 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] No waiting events found dispatching network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:45:20 user nova-compute[74638]: WARNING nova.compute.manager [req-0d357169-0e36-4084-9330-ee413ab6db4b req-e318e4d9-271a-4b48-b5a4-8e5bd2e33ed7 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received unexpected event network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 for instance with vm_state building and task_state spawning.
Nov 08 20:45:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:45:22 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a663db7f-2354-4802-820c-948377d0cc72] Instance spawned successfully.
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-97f8a2f6-9cc1-4b7a-a43d-4b9aab6d3fb4 req-67c1ac73-b09c-40b3-b65b-0723564dcf16 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received event network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97f8a2f6-9cc1-4b7a-a43d-4b9aab6d3fb4 req-67c1ac73-b09c-40b3-b65b-0723564dcf16 service nova] Acquiring lock "a663db7f-2354-4802-820c-948377d0cc72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97f8a2f6-9cc1-4b7a-a43d-4b9aab6d3fb4 req-67c1ac73-b09c-40b3-b65b-0723564dcf16 service nova] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-97f8a2f6-9cc1-4b7a-a43d-4b9aab6d3fb4 req-67c1ac73-b09c-40b3-b65b-0723564dcf16 service nova] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.compute.manager [req-97f8a2f6-9cc1-4b7a-a43d-4b9aab6d3fb4 req-67c1ac73-b09c-40b3-b65b-0723564dcf16 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] No waiting events found dispatching network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:45:22 user nova-compute[74638]: WARNING nova.compute.manager [req-97f8a2f6-9cc1-4b7a-a43d-4b9aab6d3fb4 req-67c1ac73-b09c-40b3-b65b-0723564dcf16 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received unexpected event network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 for instance with vm_state building and task_state spawning.
Nov 08 20:45:22 user nova-compute[74638]: INFO nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 08 20:45:22 user nova-compute[74638]: DEBUG nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:45:22 user nova-compute[74638]: INFO nova.compute.manager [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Took 29.37 seconds to build instance.
Nov 08 20:45:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-831cd5a7-d578-4b55-8aab-12e0d293ee65 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a663db7f-2354-4802-820c-948377d0cc72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.471s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:25 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:45:26 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53324df5-af4d-4c77-88e5-ae46854e8214 is timed out.
Nov 08 20:45:26 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully detached device vdb from instance 53324df5-af4d-4c77-88e5-ae46854e8214 from the live domain config.
Nov 08 20:45:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXMUYEKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:45:26 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfad03de-810a-4fdf-ba6f-7bf01ccd9a52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:45:26 user nova-compute[74638]: No targets found.
Nov 08 20:45:26 user nova-compute[74638]: iSNS:
Nov 08 20:45:26 user nova-compute[74638]: No targets found.
Nov 08 20:45:26 user nova-compute[74638]: STATIC:
Nov 08 20:45:26 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2
Nov 08 20:45:26 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:45:26 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:45:26 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56
Nov 08 20:45:26 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:45:26 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:45:26 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db
Nov 08 20:45:26 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:45:26 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:45:26 user nova-compute[74638]: FIRMWARE:
Nov 08 20:45:26 user nova-compute[74638]: No targets found.
Nov 08 20:45:26 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:45:26 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:45:26 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dbd475-9a4e-4b21-933a-23700654b849]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[70258fed-4cf6-4528-b007-67d7da9a1bfb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:26 user nova-compute[74638]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)
Nov 08 20:45:26 user nova-compute[74638]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:45:26 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:45:26 user nova-compute[74638]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 (non-flash)
Nov 08 20:45:26 user nova-compute[74638]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:45:26 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c5c9bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20e8d81-b5e4-4097-9e7e-1e2400f8e78d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec088218-bbd9-4685-b621-8f1c72b0f5af]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[222877da-e1d0-47ea-859a-4d8c17d88c44]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc953e6-0695-4247-88f2-3fcee57e5a05]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa912497-cd24-4fac-bae1-c3a21662ceac]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226dc97-3158-4bec-b7df-4981293daf7f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2, portal: 172.16.0.220,3260]
Nov 08 20:45:26 user nova-compute[74638]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2, portal: 172.16.0.220,3260] successful.
Nov 08 20:45:26 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b453d2a3-f17d-4a4c-98ca-057ed84e0cb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ec265-a79f-4917-a7aa-98ff64844b39]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== disconnect_volume: return (307ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:45:26 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:45:27 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:27 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:45:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:45:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:45:27 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:45:27 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid 53324df5-af4d-4c77-88e5-ae46854e8214 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:45:27 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3e43647f-55e0-4077-a44b-3b926ee07585 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.916s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updating instance_info_cache with network_info: [{"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-53324df5-af4d-4c77-88e5-ae46854e8214" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:29 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:45:29 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=25.05331802368164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 53324df5-af4d-4c77-88e5-ae46854e8214 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a663db7f-2354-4802-820c-948377d0cc72 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:45:29 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:45:30 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:45:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:32 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:32 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:32 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:33 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:45:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:45:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:45:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:45:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:45:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:45:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:45:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:45:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:45:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-f1ace8e1-37e1-4748-8bbd-1723de7b0b8f req-409ebac6-82a0-41f1-9ddd-8d87d29b8dcd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-f1ace8e1-37e1-4748-8bbd-1723de7b0b8f req-409ebac6-82a0-41f1-9ddd-8d87d29b8dcd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing instance network info cache due to event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f1ace8e1-37e1-4748-8bbd-1723de7b0b8f req-409ebac6-82a0-41f1-9ddd-8d87d29b8dcd service nova] Acquiring lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f1ace8e1-37e1-4748-8bbd-1723de7b0b8f req-409ebac6-82a0-41f1-9ddd-8d87d29b8dcd service nova] Acquired lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-f1ace8e1-37e1-4748-8bbd-1723de7b0b8f req-409ebac6-82a0-41f1-9ddd-8d87d29b8dcd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-f1ace8e1-37e1-4748-8bbd-1723de7b0b8f req-409ebac6-82a0-41f1-9ddd-8d87d29b8dcd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updated VIF entry in instance network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-f1ace8e1-37e1-4748-8bbd-1723de7b0b8f req-409ebac6-82a0-41f1-9ddd-8d87d29b8dcd service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f1ace8e1-37e1-4748-8bbd-1723de7b0b8f req-409ebac6-82a0-41f1-9ddd-8d87d29b8dcd service nova] Releasing lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-cea028e8-1f79-4e0c-9557-ccaf4d3de557 req-cfb59ed7-3632-4e14-9c9a-c38634de8149 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG nova.compute.manager [req-cea028e8-1f79-4e0c-9557-ccaf4d3de557 req-cfb59ed7-3632-4e14-9c9a-c38634de8149 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing instance network info cache due to event network-changed-a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cea028e8-1f79-4e0c-9557-ccaf4d3de557 req-cfb59ed7-3632-4e14-9c9a-c38634de8149 service nova] Acquiring lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cea028e8-1f79-4e0c-9557-ccaf4d3de557 req-cfb59ed7-3632-4e14-9c9a-c38634de8149 service nova] Acquired lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:45:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-cea028e8-1f79-4e0c-9557-ccaf4d3de557 req-cfb59ed7-3632-4e14-9c9a-c38634de8149 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Refreshing network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:54 user nova-compute[74638]: INFO nova.compute.manager [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Detaching volume 3c3e1a41-b438-4d72-a9fd-34971e4ee9db
Nov 08 20:45:54 user nova-compute[74638]: INFO nova.virt.block_device [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Attempting to driver detach volume 3c3e1a41-b438-4d72-a9fd-34971e4ee9db from mountpoint /dev/vdb
Nov 08 20:45:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Attempting to detach device vdb from instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:45:54 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:45:54 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:45:54 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:45:54 user nova-compute[74638]:   <serial>3c3e1a41-b438-4d72-a9fd-34971e4ee9db</serial>
Nov 08 20:45:54 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:45:54 user nova-compute[74638]: </disk>
Nov 08 20:45:54 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:45:54 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully detached device vdb from instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 from the persistent domain config.
Nov 08 20:45:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:45:54 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:45:54 user nova-compute[74638]:   <source dev="/dev/sdb"/>
Nov 08 20:45:54 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:45:54 user nova-compute[74638]:   <serial>3c3e1a41-b438-4d72-a9fd-34971e4ee9db</serial>
Nov 08 20:45:54 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:45:54 user nova-compute[74638]: </disk>
Nov 08 20:45:54 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG nova.network.neutron [req-cea028e8-1f79-4e0c-9557-ccaf4d3de557 req-cfb59ed7-3632-4e14-9c9a-c38634de8149 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updated VIF entry in instance network info cache for port a36c26bd-d032-4c2f-a938-a7e9f841e116. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG nova.network.neutron [req-cea028e8-1f79-4e0c-9557-ccaf4d3de557 req-cfb59ed7-3632-4e14-9c9a-c38634de8149 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [{"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-cea028e8-1f79-4e0c-9557-ccaf4d3de557 req-cfb59ed7-3632-4e14-9c9a-c38634de8149 service nova] Releasing lock "refresh_cache-22580a4e-b6c5-466a-911a-7a09e45ee3f3" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:54 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:56 user nova-compute[74638]: INFO nova.compute.manager [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Terminating instance
Nov 08 20:45:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-35f022fc-95fa-443e-b4b7-fe66095ee391 req-4fb07758-b64a-41c3-98be-7d63d343134b service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received event network-vif-unplugged-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-35f022fc-95fa-443e-b4b7-fe66095ee391 req-4fb07758-b64a-41c3-98be-7d63d343134b service nova] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-35f022fc-95fa-443e-b4b7-fe66095ee391 req-4fb07758-b64a-41c3-98be-7d63d343134b service nova] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-35f022fc-95fa-443e-b4b7-fe66095ee391 req-4fb07758-b64a-41c3-98be-7d63d343134b service nova] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-35f022fc-95fa-443e-b4b7-fe66095ee391 req-4fb07758-b64a-41c3-98be-7d63d343134b service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] No waiting events found dispatching network-vif-unplugged-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:45:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-35f022fc-95fa-443e-b4b7-fe66095ee391 req-4fb07758-b64a-41c3-98be-7d63d343134b service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received event network-vif-unplugged-07ff1024-998d-4046-b513-4ac17e1014bc for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:45:57 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Instance destroyed successfully.
Nov 08 20:45:57 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'resources' on Instance uuid 53324df5-af4d-4c77-88e5-ae46854e8214 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000017643',display_name='tempest-AttachVolumeNegativeTest-server-2000017643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000017643',id=46,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZTRTeI5adKerwZkrhjTkKCkyG/y7cMff9B0WF5Frmsahpg79yU8TltgZ9fT25B76+E9/+dqDzZ5fdx4U5S49qw+NeYZMB3NX5gDGkALDSFZ3S+egWZnZAFHJMt6JQJjQ==',key_name='tempest-keypair-651773704',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:42:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-8pzy5i5p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=53324df5-af4d-4c77-88e5-ae46854e8214,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "07ff1024-998d-4046-b513-4ac17e1014bc", "address": "fa:16:3e:2e:69:d7", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ff1024-99", "ovs_interfaceid": "07ff1024-998d-4046-b513-4ac17e1014bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:69:d7,bridge_name='br-int',has_traffic_filtering=True,id=07ff1024-998d-4046-b513-4ac17e1014bc,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ff1024-99') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG os_vif [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:69:d7,bridge_name='br-int',has_traffic_filtering=True,id=07ff1024-998d-4046-b513-4ac17e1014bc,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ff1024-99') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07ff1024-99, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8284aa9f-ab74-4d49-89e7-c63515944e44) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:45:57 user nova-compute[74638]: INFO os_vif [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:69:d7,bridge_name='br-int',has_traffic_filtering=True,id=07ff1024-998d-4046-b513-4ac17e1014bc,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ff1024-99')
Nov 08 20:45:57 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Deleting instance files /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214_del
Nov 08 20:45:57 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Deletion of /opt/stack/data/nova/instances/53324df5-af4d-4c77-88e5-ae46854e8214_del complete
Nov 08 20:45:57 user nova-compute[74638]: INFO nova.compute.manager [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 08 20:45:57 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:45:57 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:45:58 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Took 0.73 seconds to deallocate network for instance.
Nov 08 20:45:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-09d8a191-d180-48bd-8bc7-d1bf2ec0adc8 req-f375ae94-6af0-4180-a688-014c2aea066c service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received event network-vif-deleted-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:58 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Deleted allocations for instance 53324df5-af4d-4c77-88e5-ae46854e8214
Nov 08 20:45:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a2986d2b-2b63-4ad8-a6e9-b3c021759390 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "53324df5-af4d-4c77-88e5-ae46854e8214" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-b27937bc-f2de-475c-bfea-d1abbffb19bc req-e42538bb-1863-4e6c-9c6d-eb7a2db0243b service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received event network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b27937bc-f2de-475c-bfea-d1abbffb19bc req-e42538bb-1863-4e6c-9c6d-eb7a2db0243b service nova] Acquiring lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b27937bc-f2de-475c-bfea-d1abbffb19bc req-e42538bb-1863-4e6c-9c6d-eb7a2db0243b service nova] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b27937bc-f2de-475c-bfea-d1abbffb19bc req-e42538bb-1863-4e6c-9c6d-eb7a2db0243b service nova] Lock "53324df5-af4d-4c77-88e5-ae46854e8214-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:45:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-b27937bc-f2de-475c-bfea-d1abbffb19bc req-e42538bb-1863-4e6c-9c6d-eb7a2db0243b service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] No waiting events found dispatching network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:45:58 user nova-compute[74638]: WARNING nova.compute.manager [req-b27937bc-f2de-475c-bfea-d1abbffb19bc req-e42538bb-1863-4e6c-9c6d-eb7a2db0243b service nova] [instance: 53324df5-af4d-4c77-88e5-ae46854e8214] Received unexpected event network-vif-plugged-07ff1024-998d-4046-b513-4ac17e1014bc for instance with vm_state deleted and task_state None.
Nov 08 20:46:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:46:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:46:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:46:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:14 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 is timed out.
Nov 08 20:46:14 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully detached device vdb from instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 from the live domain config.
Nov 08 20:46:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhpaRrvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:46:14 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc95fae-87f0-4d67-b70e-44a0dd582c6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:46:14 user nova-compute[74638]: No targets found.
Nov 08 20:46:14 user nova-compute[74638]: iSNS:
Nov 08 20:46:14 user nova-compute[74638]: No targets found.
Nov 08 20:46:14 user nova-compute[74638]: STATIC:
Nov 08 20:46:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56
Nov 08 20:46:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:46:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:46:14 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db
Nov 08 20:46:14 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:46:14 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:46:14 user nova-compute[74638]: FIRMWARE:
Nov 08 20:46:14 user nova-compute[74638]: No targets found.
Nov 08 20:46:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:46:14 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:46:14 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e88f324-ce8c-4b1e-a72e-158fac66ff7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7c2785-eccb-4ac6-be5e-fb18bd5a9f4a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:46:14 user nova-compute[74638]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:46:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db (non-flash)
Nov 08 20:46:14 user nova-compute[74638]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:46:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c3e60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d4b291-ab62-4f3a-8413-785d009174b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4af07c-ab4c-4b44-83a5-97da77f994a3]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e384e10-a214-4826-af8c-f75629bb350f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dedc6d7-b778-4885-a294-2df3fc60cb11]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bf920a-74db-4e16-8410-4397733b789c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[39835e1e-a51b-46dd-89f3-bcb75deb808b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db, portal: 172.16.0.220,3260]
Nov 08 20:46:14 user nova-compute[74638]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db, portal: 172.16.0.220,3260] successful.
Nov 08 20:46:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3e1a41-b438-4d72-a9fd-34971e4ee9db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da57daf-a6b7-4c75-8767-3236221d48e1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] <== disconnect_volume: return (291ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:46:14 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:46:15 user nova-compute[74638]: DEBUG nova.objects.instance [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'flavor' on Instance uuid 22580a4e-b6c5-466a-911a-7a09e45ee3f3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:46:15 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-3a2c34fa-726e-49a2-9436-9356a6819f52 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:22 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:46:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:46:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:46:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:27 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:27 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:28 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:29 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:46:29 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:46:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8750MB free_disk=25.079792022705078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance a663db7f-2354-4802-820c-948377d0cc72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:46:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:46:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:46:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:32 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:32 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:38 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:46:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-306dcb25-afe4-4afd-9a7b-78e5ff74ba11 req-8ef2958a-e924-44d8-b226-ff18fd1516b5 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received event network-changed-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-306dcb25-afe4-4afd-9a7b-78e5ff74ba11 req-8ef2958a-e924-44d8-b226-ff18fd1516b5 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Refreshing instance network info cache due to event network-changed-1b18b2c3-8abc-4906-9faa-2497bd894580. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:46:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-306dcb25-afe4-4afd-9a7b-78e5ff74ba11 req-8ef2958a-e924-44d8-b226-ff18fd1516b5 service nova] Acquiring lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:46:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-306dcb25-afe4-4afd-9a7b-78e5ff74ba11 req-8ef2958a-e924-44d8-b226-ff18fd1516b5 service nova] Acquired lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:46:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-306dcb25-afe4-4afd-9a7b-78e5ff74ba11 req-8ef2958a-e924-44d8-b226-ff18fd1516b5 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Refreshing network info cache for port 1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG nova.network.neutron [req-306dcb25-afe4-4afd-9a7b-78e5ff74ba11 req-8ef2958a-e924-44d8-b226-ff18fd1516b5 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Updated VIF entry in instance network info cache for port 1b18b2c3-8abc-4906-9faa-2497bd894580. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG nova.network.neutron [req-306dcb25-afe4-4afd-9a7b-78e5ff74ba11 req-8ef2958a-e924-44d8-b226-ff18fd1516b5 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Updating instance_info_cache with network_info: [{"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-306dcb25-afe4-4afd-9a7b-78e5ff74ba11 req-8ef2958a-e924-44d8-b226-ff18fd1516b5 service nova] Releasing lock "refresh_cache-a663db7f-2354-4802-820c-948377d0cc72" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "a663db7f-2354-4802-820c-948377d0cc72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a663db7f-2354-4802-820c-948377d0cc72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "a663db7f-2354-4802-820c-948377d0cc72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:46 user nova-compute[74638]: INFO nova.compute.manager [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Terminating instance
Nov 08 20:46:46 user nova-compute[74638]: DEBUG nova.compute.manager [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-27fc0342-a24c-43a2-81de-c9912b610475 req-1e2ab280-dae3-4f0f-9d6b-4e33600b97c0 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received event network-vif-unplugged-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-27fc0342-a24c-43a2-81de-c9912b610475 req-1e2ab280-dae3-4f0f-9d6b-4e33600b97c0 service nova] Acquiring lock "a663db7f-2354-4802-820c-948377d0cc72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-27fc0342-a24c-43a2-81de-c9912b610475 req-1e2ab280-dae3-4f0f-9d6b-4e33600b97c0 service nova] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-27fc0342-a24c-43a2-81de-c9912b610475 req-1e2ab280-dae3-4f0f-9d6b-4e33600b97c0 service nova] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-27fc0342-a24c-43a2-81de-c9912b610475 req-1e2ab280-dae3-4f0f-9d6b-4e33600b97c0 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] No waiting events found dispatching network-vif-unplugged-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:46:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-27fc0342-a24c-43a2-81de-c9912b610475 req-1e2ab280-dae3-4f0f-9d6b-4e33600b97c0 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received event network-vif-unplugged-1b18b2c3-8abc-4906-9faa-2497bd894580 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: a663db7f-2354-4802-820c-948377d0cc72] Instance destroyed successfully.
Nov 08 20:46:47 user nova-compute[74638]: DEBUG nova.objects.instance [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'resources' on Instance uuid a663db7f-2354-4802-820c-948377d0cc72 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:44:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1944614699',display_name='tempest-TestVolumeBootPattern-server-1944614699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1944614699',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:45:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-gqhy40i8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:45:23Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=a663db7f-2354-4802-820c-948377d0cc72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "1b18b2c3-8abc-4906-9faa-2497bd894580", "address": "fa:16:3e:ae:0d:e7", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b18b2c3-8a", "ovs_interfaceid": "1b18b2c3-8abc-4906-9faa-2497bd894580", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:0d:e7,bridge_name='br-int',has_traffic_filtering=True,id=1b18b2c3-8abc-4906-9faa-2497bd894580,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b18b2c3-8a') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_vif [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:0d:e7,bridge_name='br-int',has_traffic_filtering=True,id=1b18b2c3-8abc-4906-9faa-2497bd894580,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b18b2c3-8a') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b18b2c3-8a, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34d38ffe-97ff-46c0-99a6-dcca3b3f8bb3) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:47 user nova-compute[74638]: INFO os_vif [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:0d:e7,bridge_name='br-int',has_traffic_filtering=True,id=1b18b2c3-8abc-4906-9faa-2497bd894580,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b18b2c3-8a')
Nov 08 20:46:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaZhkXFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:46:47 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[977538ec-f29c-40ad-8c3f-1e3ea3ebd4f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:46:47 user nova-compute[74638]: No targets found.
Nov 08 20:46:47 user nova-compute[74638]: iSNS:
Nov 08 20:46:47 user nova-compute[74638]: No targets found.
Nov 08 20:46:47 user nova-compute[74638]: STATIC:
Nov 08 20:46:47 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56
Nov 08 20:46:47 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:46:47 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:46:47 user nova-compute[74638]: FIRMWARE:
Nov 08 20:46:47 user nova-compute[74638]: No targets found.
Nov 08 20:46:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:46:47 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:46:47 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0dfa3f-38fc-481f-a6c4-92df842c44b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[199bcd4f-6a5e-4eb3-9669-276b513a60ff]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:46:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:46:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c2f0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e57a3-7e18-4ff3-a23d-06bb18d553cc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c2f3f-cf29-4140-814f-3bee23eb73f8]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a15ee-f3bf-427f-a8e8-8b461605b1e1]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c872447-a4d8-465b-93a8-73a24d1c8c15]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee5729d-8e5e-47b3-9fc2-19b4756e5a04]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c7553-3a06-4b9d-bf80-9854537b5f0b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260]
Nov 08 20:46:47 user nova-compute[74638]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260] successful.
Nov 08 20:46:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[801fa461-5e55-4230-927e-a9bf99d909c0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== disconnect_volume: return (325ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:46:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Deleting instance files /opt/stack/data/nova/instances/a663db7f-2354-4802-820c-948377d0cc72_del
Nov 08 20:46:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Deletion of /opt/stack/data/nova/instances/a663db7f-2354-4802-820c-948377d0cc72_del complete
Nov 08 20:46:47 user nova-compute[74638]: INFO nova.compute.manager [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 08 20:46:47 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: a663db7f-2354-4802-820c-948377d0cc72] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:46:47 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a663db7f-2354-4802-820c-948377d0cc72] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:46:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-a142edb9-177f-42fb-babb-560d2249846c req-de307217-1d80-4840-9251-13df8ce702f0 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received event network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a142edb9-177f-42fb-babb-560d2249846c req-de307217-1d80-4840-9251-13df8ce702f0 service nova] Acquiring lock "a663db7f-2354-4802-820c-948377d0cc72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a142edb9-177f-42fb-babb-560d2249846c req-de307217-1d80-4840-9251-13df8ce702f0 service nova] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a142edb9-177f-42fb-babb-560d2249846c req-de307217-1d80-4840-9251-13df8ce702f0 service nova] Lock "a663db7f-2354-4802-820c-948377d0cc72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-a142edb9-177f-42fb-babb-560d2249846c req-de307217-1d80-4840-9251-13df8ce702f0 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] No waiting events found dispatching network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:46:48 user nova-compute[74638]: WARNING nova.compute.manager [req-a142edb9-177f-42fb-babb-560d2249846c req-de307217-1d80-4840-9251-13df8ce702f0 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received unexpected event network-vif-plugged-1b18b2c3-8abc-4906-9faa-2497bd894580 for instance with vm_state active and task_state deleting.
Nov 08 20:46:49 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: a663db7f-2354-4802-820c-948377d0cc72] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:46:49 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: a663db7f-2354-4802-820c-948377d0cc72] Took 1.92 seconds to deallocate network for instance.
Nov 08 20:46:49 user nova-compute[74638]: DEBUG nova.compute.manager [req-ed6db628-47a0-40ca-bd1b-a9aa5b0cf84a req-d2d9bdc8-6a2a-45d8-a8b3-a12938035e12 service nova] [instance: a663db7f-2354-4802-820c-948377d0cc72] Received event network-vif-deleted-1b18b2c3-8abc-4906-9faa-2497bd894580 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:50 user nova-compute[74638]: INFO nova.compute.manager [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: a663db7f-2354-4802-820c-948377d0cc72] Took 1.03 seconds to detach 1 volumes for instance.
Nov 08 20:46:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.106s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:46:50 user nova-compute[74638]: INFO nova.compute.claims [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Claim successful on node user
Nov 08 20:46:50 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Deleted allocations for instance a663db7f-2354-4802-820c-948377d0cc72
Nov 08 20:46:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-68f2b285-f650-440c-a98a-751253b4659c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "a663db7f-2354-4802-820c-948377d0cc72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.523s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:46:51 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.policy [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55df27e8271941e8ac7825d6999ce486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a349308d9cb9419f9981a9d28ea61248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:46:51 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Creating image(s)
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "/opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "/opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk 1073741824 {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835,backing_fmt=raw /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk 1073741824" returned: 0 in 0.060s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "4487219dd3b0c43ad4e302ef25c357777ad2c835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Successfully created port: 68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4487219dd3b0c43ad4e302ef25c357777ad2c835 --force-share --output=json" returned: 0 in 0.194s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk. size=1073741824 {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 20:46:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG nova.virt.disk.api [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Cannot resize image /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk to a smaller size. {{(pid=74638) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Created local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Ensure instance console log exists: /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Successfully updated port: 68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquired lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-5f714555-4908-4bf3-8db9-709a8be70c74 req-116acbd9-a1e9-4ac7-a5e3-ea385cb6ba49 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received event network-changed-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-5f714555-4908-4bf3-8db9-709a8be70c74 req-116acbd9-a1e9-4ac7-a5e3-ea385cb6ba49 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Refreshing instance network info cache due to event network-changed-68286e42-0782-479d-b073-b0f9fa35c087. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5f714555-4908-4bf3-8db9-709a8be70c74 req-116acbd9-a1e9-4ac7-a5e3-ea385cb6ba49 service nova] Acquiring lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:46:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updating instance_info_cache with network_info: [{"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Releasing lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Instance network_info: |[{"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5f714555-4908-4bf3-8db9-709a8be70c74 req-116acbd9-a1e9-4ac7-a5e3-ea385cb6ba49 service nova] Acquired lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-5f714555-4908-4bf3-8db9-709a8be70c74 req-116acbd9-a1e9-4ac7-a5e3-ea385cb6ba49 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Refreshing network info cache for port 68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Start _get_guest_xml network_info=[{"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2378b081-1a49-4717-81bb-a291ba1a9d32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:46:53 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:46:53 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T20:02:14Z,direct_url=<?>,disk_format='qcow2',id=2378b081-1a49-4717-81bb-a291ba1a9d32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6d04b04bab24403bbb2bd99d8dea0ded',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T20:02:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-434568106',display_name='tempest-AttachVolumeNegativeTest-server-434568106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-434568106',id=49,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRJMGpoJluA7oRLjaNq7iuj1CusW5elJ86QUH4CSiyXodaYA5U4CvTFKsGzZvAl1jJceZl86tFWZEqlhAswpar1wbhddLtlO5F11K89MQrGSuTc9rsrRckM48IzuPkW2A==',key_name='tempest-keypair-943853309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-3juuqz00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:46:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=d8a98545-b288-4b73-bdd3-07492e968a9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ea:43,bridge_name='br-int',has_traffic_filtering=True,id=68286e42-0782-479d-b073-b0f9fa35c087,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286e42-07') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'pci_devices' on Instance uuid d8a98545-b288-4b73-bdd3-07492e968a9c {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:46:53 user nova-compute[74638]:   <uuid>d8a98545-b288-4b73-bdd3-07492e968a9c</uuid>
Nov 08 20:46:53 user nova-compute[74638]:   <name>instance-00000031</name>
Nov 08 20:46:53 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:46:53 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:46:53 user nova-compute[74638]:   <metadata>
Nov 08 20:46:53 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:46:53 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:46:53 user nova-compute[74638]:       <nova:name>tempest-AttachVolumeNegativeTest-server-434568106</nova:name>
Nov 08 20:46:53 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:46:53</nova:creationTime>
Nov 08 20:46:53 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:46:53 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:46:53 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:46:53 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:46:53 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:46:53 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:46:53 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:46:53 user nova-compute[74638]:       <nova:owner>
Nov 08 20:46:53 user nova-compute[74638]:         <nova:user uuid="55df27e8271941e8ac7825d6999ce486">tempest-AttachVolumeNegativeTest-1913966386-project-member</nova:user>
Nov 08 20:46:53 user nova-compute[74638]:         <nova:project uuid="a349308d9cb9419f9981a9d28ea61248">tempest-AttachVolumeNegativeTest-1913966386</nova:project>
Nov 08 20:46:53 user nova-compute[74638]:       </nova:owner>
Nov 08 20:46:53 user nova-compute[74638]:       <nova:root type="image" uuid="2378b081-1a49-4717-81bb-a291ba1a9d32"/>
Nov 08 20:46:53 user nova-compute[74638]:       <nova:ports>
Nov 08 20:46:53 user nova-compute[74638]:         <nova:port uuid="68286e42-0782-479d-b073-b0f9fa35c087">
Nov 08 20:46:53 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 20:46:53 user nova-compute[74638]:         </nova:port>
Nov 08 20:46:53 user nova-compute[74638]:       </nova:ports>
Nov 08 20:46:53 user nova-compute[74638]:     </nova:instance>
Nov 08 20:46:53 user nova-compute[74638]:   </metadata>
Nov 08 20:46:53 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:46:53 user nova-compute[74638]:     <system>
Nov 08 20:46:53 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:46:53 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:46:53 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:46:53 user nova-compute[74638]:       <entry name="serial">d8a98545-b288-4b73-bdd3-07492e968a9c</entry>
Nov 08 20:46:53 user nova-compute[74638]:       <entry name="uuid">d8a98545-b288-4b73-bdd3-07492e968a9c</entry>
Nov 08 20:46:53 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:46:53 user nova-compute[74638]:     </system>
Nov 08 20:46:53 user nova-compute[74638]:   </sysinfo>
Nov 08 20:46:53 user nova-compute[74638]:   <os>
Nov 08 20:46:53 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:46:53 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:46:53 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:46:53 user nova-compute[74638]:   </os>
Nov 08 20:46:53 user nova-compute[74638]:   <features>
Nov 08 20:46:53 user nova-compute[74638]:     <acpi/>
Nov 08 20:46:53 user nova-compute[74638]:     <apic/>
Nov 08 20:46:53 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:46:53 user nova-compute[74638]:   </features>
Nov 08 20:46:53 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:46:53 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:46:53 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:46:53 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:46:53 user nova-compute[74638]:   </clock>
Nov 08 20:46:53 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:46:53 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:46:53 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:46:53 user nova-compute[74638]:   </cpu>
Nov 08 20:46:53 user nova-compute[74638]:   <devices>
Nov 08 20:46:53 user nova-compute[74638]:     <disk type="file" device="disk">
Nov 08 20:46:53 user nova-compute[74638]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 20:46:53 user nova-compute[74638]:       <source file="/opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk"/>
Nov 08 20:46:53 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:46:53 user nova-compute[74638]:     </disk>
Nov 08 20:46:53 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:46:53 user nova-compute[74638]:       <mac address="fa:16:3e:4d:ea:43"/>
Nov 08 20:46:53 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:46:53 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:46:53 user nova-compute[74638]:       <target dev="tap68286e42-07"/>
Nov 08 20:46:53 user nova-compute[74638]:     </interface>
Nov 08 20:46:53 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:46:53 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/console.log" append="off"/>
Nov 08 20:46:53 user nova-compute[74638]:     </serial>
Nov 08 20:46:53 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:46:53 user nova-compute[74638]:     <video>
Nov 08 20:46:53 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:46:53 user nova-compute[74638]:     </video>
Nov 08 20:46:53 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:46:53 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:46:53 user nova-compute[74638]:     </rng>
Nov 08 20:46:53 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:46:53 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:46:53 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:46:53 user nova-compute[74638]:     </memballoon>
Nov 08 20:46:53 user nova-compute[74638]:   </devices>
Nov 08 20:46:53 user nova-compute[74638]: </domain>
Nov 08 20:46:53 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-434568106',display_name='tempest-AttachVolumeNegativeTest-server-434568106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-434568106',id=49,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRJMGpoJluA7oRLjaNq7iuj1CusW5elJ86QUH4CSiyXodaYA5U4CvTFKsGzZvAl1jJceZl86tFWZEqlhAswpar1wbhddLtlO5F11K89MQrGSuTc9rsrRckM48IzuPkW2A==',key_name='tempest-keypair-943853309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-3juuqz00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:46:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=d8a98545-b288-4b73-bdd3-07492e968a9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ea:43,bridge_name='br-int',has_traffic_filtering=True,id=68286e42-0782-479d-b073-b0f9fa35c087,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286e42-07') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG os_vif [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ea:43,bridge_name='br-int',has_traffic_filtering=True,id=68286e42-0782-479d-b073-b0f9fa35c087,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286e42-07') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54e8e339-553e-52ff-bced-9e806146673c', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68286e42-07, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68286e42-07, col_values=(('qos', UUID('4cc9075e-201d-4ab1-a53c-340394c714b1')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68286e42-07, col_values=(('external_ids', {'iface-id': '68286e42-0782-479d-b073-b0f9fa35c087', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:ea:43', 'vm-uuid': 'd8a98545-b288-4b73-bdd3-07492e968a9c'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:53 user nova-compute[74638]: INFO os_vif [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ea:43,bridge_name='br-int',has_traffic_filtering=True,id=68286e42-0782-479d-b073-b0f9fa35c087,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286e42-07')
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No VIF found with MAC fa:16:3e:4d:ea:43, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-5f714555-4908-4bf3-8db9-709a8be70c74 req-116acbd9-a1e9-4ac7-a5e3-ea385cb6ba49 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updated VIF entry in instance network info cache for port 68286e42-0782-479d-b073-b0f9fa35c087. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-5f714555-4908-4bf3-8db9-709a8be70c74 req-116acbd9-a1e9-4ac7-a5e3-ea385cb6ba49 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updating instance_info_cache with network_info: [{"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:46:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5f714555-4908-4bf3-8db9-709a8be70c74 req-116acbd9-a1e9-4ac7-a5e3-ea385cb6ba49 service nova] Releasing lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:46:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-8ae359ef-d065-4266-9d62-9d42f2483d10 req-fbe76590-8f05-40ab-86c6-0fd552d344d5 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received event network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ae359ef-d065-4266-9d62-9d42f2483d10 req-fbe76590-8f05-40ab-86c6-0fd552d344d5 service nova] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ae359ef-d065-4266-9d62-9d42f2483d10 req-fbe76590-8f05-40ab-86c6-0fd552d344d5 service nova] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:54 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-8ae359ef-d065-4266-9d62-9d42f2483d10 req-fbe76590-8f05-40ab-86c6-0fd552d344d5 service nova] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:54 user nova-compute[74638]: DEBUG nova.compute.manager [req-8ae359ef-d065-4266-9d62-9d42f2483d10 req-fbe76590-8f05-40ab-86c6-0fd552d344d5 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] No waiting events found dispatching network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:46:54 user nova-compute[74638]: WARNING nova.compute.manager [req-8ae359ef-d065-4266-9d62-9d42f2483d10 req-fbe76590-8f05-40ab-86c6-0fd552d344d5 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received unexpected event network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 for instance with vm_state building and task_state spawning.
Nov 08 20:46:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:56 user nova-compute[74638]: INFO nova.compute.manager [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Terminating instance
Nov 08 20:46:56 user nova-compute[74638]: DEBUG nova.compute.manager [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-83eff230-1a4f-44cc-8ea9-05777b581d2e req-af42820c-f5aa-465b-8339-a5fe984c4779 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-unplugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-83eff230-1a4f-44cc-8ea9-05777b581d2e req-af42820c-f5aa-465b-8339-a5fe984c4779 service nova] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-83eff230-1a4f-44cc-8ea9-05777b581d2e req-af42820c-f5aa-465b-8339-a5fe984c4779 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-83eff230-1a4f-44cc-8ea9-05777b581d2e req-af42820c-f5aa-465b-8339-a5fe984c4779 service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-83eff230-1a4f-44cc-8ea9-05777b581d2e req-af42820c-f5aa-465b-8339-a5fe984c4779 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] No waiting events found dispatching network-vif-unplugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:46:56 user nova-compute[74638]: DEBUG nova.compute.manager [req-83eff230-1a4f-44cc-8ea9-05777b581d2e req-af42820c-f5aa-465b-8339-a5fe984c4779 service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-unplugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-a1c564eb-c5d5-4665-bf82-55175f691cb1 req-7b4b32c2-6308-45a9-8011-f6a921d840a7 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received event network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a1c564eb-c5d5-4665-bf82-55175f691cb1 req-7b4b32c2-6308-45a9-8011-f6a921d840a7 service nova] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a1c564eb-c5d5-4665-bf82-55175f691cb1 req-7b4b32c2-6308-45a9-8011-f6a921d840a7 service nova] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-a1c564eb-c5d5-4665-bf82-55175f691cb1 req-7b4b32c2-6308-45a9-8011-f6a921d840a7 service nova] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.compute.manager [req-a1c564eb-c5d5-4665-bf82-55175f691cb1 req-7b4b32c2-6308-45a9-8011-f6a921d840a7 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] No waiting events found dispatching network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:46:57 user nova-compute[74638]: WARNING nova.compute.manager [req-a1c564eb-c5d5-4665-bf82-55175f691cb1 req-7b4b32c2-6308-45a9-8011-f6a921d840a7 service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received unexpected event network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 for instance with vm_state building and task_state spawning.
Nov 08 20:46:57 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Instance destroyed successfully.
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.objects.instance [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lazy-loading 'resources' on Instance uuid 22580a4e-b6c5-466a-911a-7a09e45ee3f3 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:41:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1399672828',display_name='tempest-TestMinimumBasicScenario-server-1399672828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1399672828',id=45,image_ref='eaff999b-f1b8-436a-af02-c8a314d15c3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAapiI1Glq1I2Y4Amg3CMzcCNj29SRCbJNPiwJqauOstTYipQICcw0P122r+UBOwk6sIflNPH8QGVhz6QsbLgE8Q6iOi5xKRk6beM5TX4DjsQgY+gekNMJFMjond5Vhi7Q==',key_name='tempest-TestMinimumBasicScenario-1679928950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45c12f4f25aa40889f55cc73ac02a098',ramdisk_id='',reservation_id='r-vmb2qs48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eaff999b-f1b8-436a-af02-c8a314d15c3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1423913344',owner_user_name='tempest-TestMinimumBasicScenario-1423913344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:44:08Z,user_data=None,user_id='055e6d6be11a4365af65a6f5090eee90',uuid=22580a4e-b6c5-466a-911a-7a09e45ee3f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converting VIF {"id": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "address": "fa:16:3e:51:9a:a5", "network": {"id": "62332f9d-fa48-45fc-9050-395f828b726f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1077008235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45c12f4f25aa40889f55cc73ac02a098", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36c26bd-d0", "ovs_interfaceid": "a36c26bd-d032-4c2f-a938-a7e9f841e116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:9a:a5,bridge_name='br-int',has_traffic_filtering=True,id=a36c26bd-d032-4c2f-a938-a7e9f841e116,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c26bd-d0') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG os_vif [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:9a:a5,bridge_name='br-int',has_traffic_filtering=True,id=a36c26bd-d032-4c2f-a938-a7e9f841e116,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c26bd-d0') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa36c26bd-d0, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5c95eda-34aa-4cbc-afad-f86cbddd8f43) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:46:57 user nova-compute[74638]: INFO os_vif [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:9a:a5,bridge_name='br-int',has_traffic_filtering=True,id=a36c26bd-d032-4c2f-a938-a7e9f841e116,network=Network(62332f9d-fa48-45fc-9050-395f828b726f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36c26bd-d0')
Nov 08 20:46:57 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Deleting instance files /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3_del
Nov 08 20:46:57 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Deletion of /opt/stack/data/nova/instances/22580a4e-b6c5-466a-911a-7a09e45ee3f3_del complete
Nov 08 20:46:57 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Instance spawned successfully.
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:46:57 user nova-compute[74638]: INFO nova.compute.manager [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 20:46:57 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:46:57 user nova-compute[74638]: INFO nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:46:57 user nova-compute[74638]: INFO nova.compute.manager [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Took 6.74 seconds to build instance.
Nov 08 20:46:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c7985cb5-b501-44df-ae43-3b62a599c71c tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.847s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:46:57 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Took 0.46 seconds to deallocate network for instance.
Nov 08 20:46:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:46:57 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:46:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:58 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Deleted allocations for instance 22580a4e-b6c5-466a-911a-7a09e45ee3f3
Nov 08 20:46:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-8f4cd1cb-651a-4004-860c-3129bc03ff84 tempest-TestMinimumBasicScenario-1423913344 tempest-TestMinimumBasicScenario-1423913344-project-member] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.924s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-b54ea8e2-6f0c-4b6b-a883-54be9a6b5f26 req-50d4aa0e-746f-4c26-9760-f2cda82e9e8b service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b54ea8e2-6f0c-4b6b-a883-54be9a6b5f26 req-50d4aa0e-746f-4c26-9760-f2cda82e9e8b service nova] Acquiring lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:46:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b54ea8e2-6f0c-4b6b-a883-54be9a6b5f26 req-50d4aa0e-746f-4c26-9760-f2cda82e9e8b service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:46:58 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b54ea8e2-6f0c-4b6b-a883-54be9a6b5f26 req-50d4aa0e-746f-4c26-9760-f2cda82e9e8b service nova] Lock "22580a4e-b6c5-466a-911a-7a09e45ee3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:46:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-b54ea8e2-6f0c-4b6b-a883-54be9a6b5f26 req-50d4aa0e-746f-4c26-9760-f2cda82e9e8b service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] No waiting events found dispatching network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:46:58 user nova-compute[74638]: WARNING nova.compute.manager [req-b54ea8e2-6f0c-4b6b-a883-54be9a6b5f26 req-50d4aa0e-746f-4c26-9760-f2cda82e9e8b service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received unexpected event network-vif-plugged-a36c26bd-d032-4c2f-a938-a7e9f841e116 for instance with vm_state deleted and task_state None.
Nov 08 20:46:58 user nova-compute[74638]: DEBUG nova.compute.manager [req-b54ea8e2-6f0c-4b6b-a883-54be9a6b5f26 req-50d4aa0e-746f-4c26-9760-f2cda82e9e8b service nova] [instance: 22580a4e-b6c5-466a-911a-7a09e45ee3f3] Received event network-vif-deleted-a36c26bd-d032-4c2f-a938-a7e9f841e116 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:46:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:07 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:47:12 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:47:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:25 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:27 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:27 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:27 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:47:29 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:47:30 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:47:30 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=25.076858520507812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d8a98545-b288-4b73-bdd3-07492e968a9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:47:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:31 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:31 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:47:31 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:47:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:47:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:47:31 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:47:31 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid d8a98545-b288-4b73-bdd3-07492e968a9c {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:47:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:32 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updating instance_info_cache with network_info: [{"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:47:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:47:32 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:47:32 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:32 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:33 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:34 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:47:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:47:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:47:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:47:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:47:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:47:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:47:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:47:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:47:38 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:47:38 user nova-compute[74638]: INFO nova.compute.claims [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Claim successful on node user
Nov 08 20:47:39 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:47:39 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:47:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:47:39 user nova-compute[74638]: INFO nova.virt.block_device [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Booting with volume 9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 at /dev/vda
Nov 08 20:47:39 user nova-compute[74638]: DEBUG nova.policy [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63d3b55213f44fbb4dd76758a9a61ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e599a20be834415ea60230b8743a2338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG os_brick.utils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8281c6-f929-48d4-9f48-ccf10ee65360]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b481511-fd7b-476c-84c9-6254827721a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c45995-0164-40e6-ba9c-39c8f402f699]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffcd43b-67b2-4191-b596-69d4a5df5de3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:47:39 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:47:39 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faf414e-d77e-4121-830b-f3aa2b715ee9]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG os_brick.utils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:47:39 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating existing volume attachment record: 5cc3ced5-26b7-4c89-a0fc-24030afa026a {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:47:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Successfully created port: df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Successfully updated port: df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquired lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-b7cb4781-9392-4c5f-b26f-b2cfaab5497f req-98916732-d6e1-473f-9cdb-a6732c299592 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-changed-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-b7cb4781-9392-4c5f-b26f-b2cfaab5497f req-98916732-d6e1-473f-9cdb-a6732c299592 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Refreshing instance network info cache due to event network-changed-df50b40c-dacf-455f-baf0-d8a9ebc22fdc. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b7cb4781-9392-4c5f-b26f-b2cfaab5497f req-98916732-d6e1-473f-9cdb-a6732c299592 service nova] Acquiring lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.network.neutron [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating instance_info_cache with network_info: [{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Releasing lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Instance network_info: |[{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b7cb4781-9392-4c5f-b26f-b2cfaab5497f req-98916732-d6e1-473f-9cdb-a6732c299592 service nova] Acquired lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-b7cb4781-9392-4c5f-b26f-b2cfaab5497f req-98916732-d6e1-473f-9cdb-a6732c299592 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Refreshing network info cache for port df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-b7cb4781-9392-4c5f-b26f-b2cfaab5497f req-98916732-d6e1-473f-9cdb-a6732c299592 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updated VIF entry in instance network info cache for port df50b40c-dacf-455f-baf0-d8a9ebc22fdc. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-b7cb4781-9392-4c5f-b26f-b2cfaab5497f req-98916732-d6e1-473f-9cdb-a6732c299592 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating instance_info_cache with network_info: [{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:47:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-b7cb4781-9392-4c5f-b26f-b2cfaab5497f req-98916732-d6e1-473f-9cdb-a6732c299592 service nova] Releasing lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:47:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:42 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:47 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:48 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:52 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:53 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:57 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:47:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:02 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:48:03 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Creating image(s)
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Ensure instance console log exists: /opt/stack/data/nova/instances/c0f1bb8d-6ad1-4586-bda0-9d6838319e55/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Start _get_guest_xml network_info=[{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '5cc3ced5-26b7-4c89-a0fc-24030afa026a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaZhkXFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0f1bb8d-6ad1-4586-bda0-9d6838319e55', 'attached_at': '', 'detached_at': '', 'volume_id': '9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'serial': '9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:48:03 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:48:03 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaZhkXFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:48:03 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:48:03 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:48:03 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5506c346-99d0-4357-b300-bb0c9afc0653]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:48:03 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba276ad9-921b-4221-b15b-ca63294721ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56] added
Nov 08 20:48:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b26e1c-3f4e-46ab-9050-a3e8fafcbddd]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6c5cd9-e42b-40da-95ea-1b2c7eeb3d33]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PaZhkXFE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PaZhkXFE" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dfa06f-1edd-4593-a2f6-1888914c626b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PaZhkXFE'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2838d70-4183-4a4c-9a9c-091c2cda212e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c174cd8c-b6d2-4513-9e6a-61675f2f43f1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:48:03 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 20:48:03 user nova-compute[74638]:  {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:48:03 user nova-compute[74638]: WARNING os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 20:48:03 user nova-compute[74638]: 
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd7ae23-deb1-49fe-a761-123778bcf7a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260]
Nov 08 20:48:03 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260] successful.
Nov 08 20:48:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ee8c71-d00b-45f9-ac24-a23b5aa03ed0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be2e5db-fa38-4679-9276-578033324eaf]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:48:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:48:03 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13b73f-0f9f-4ef2-9dd3-50fc565ed1bf]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:03 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaZhkXFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26533306663303936', 'path': '/dev/sdb'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533306663303936', 'path': '/dev/sdb'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1842722633',display_name='tempest-TestVolumeBootPattern-server-1842722633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1842722633',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-fjh13w1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:47:39Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=c0f1bb8d-6ad1-4586-bda0-9d6838319e55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ab:a2,bridge_name='br-int',has_traffic_filtering=True,id=df50b40c-dacf-455f-baf0-d8a9ebc22fdc,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf50b40c-da') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.objects.instance [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f1bb8d-6ad1-4586-bda0-9d6838319e55 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:48:04 user nova-compute[74638]:   <uuid>c0f1bb8d-6ad1-4586-bda0-9d6838319e55</uuid>
Nov 08 20:48:04 user nova-compute[74638]:   <name>instance-00000032</name>
Nov 08 20:48:04 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:48:04 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:48:04 user nova-compute[74638]:   <metadata>
Nov 08 20:48:04 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:48:04 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:48:04 user nova-compute[74638]:       <nova:name>tempest-TestVolumeBootPattern-server-1842722633</nova:name>
Nov 08 20:48:04 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:48:03</nova:creationTime>
Nov 08 20:48:04 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:48:04 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:48:04 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:48:04 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:48:04 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:48:04 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:48:04 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:48:04 user nova-compute[74638]:       <nova:owner>
Nov 08 20:48:04 user nova-compute[74638]:         <nova:user uuid="f63d3b55213f44fbb4dd76758a9a61ed">tempest-TestVolumeBootPattern-1116596406-project-member</nova:user>
Nov 08 20:48:04 user nova-compute[74638]:         <nova:project uuid="e599a20be834415ea60230b8743a2338">tempest-TestVolumeBootPattern-1116596406</nova:project>
Nov 08 20:48:04 user nova-compute[74638]:       </nova:owner>
Nov 08 20:48:04 user nova-compute[74638]:       <nova:ports>
Nov 08 20:48:04 user nova-compute[74638]:         <nova:port uuid="df50b40c-dacf-455f-baf0-d8a9ebc22fdc">
Nov 08 20:48:04 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 20:48:04 user nova-compute[74638]:         </nova:port>
Nov 08 20:48:04 user nova-compute[74638]:       </nova:ports>
Nov 08 20:48:04 user nova-compute[74638]:     </nova:instance>
Nov 08 20:48:04 user nova-compute[74638]:   </metadata>
Nov 08 20:48:04 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:48:04 user nova-compute[74638]:     <system>
Nov 08 20:48:04 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:48:04 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:48:04 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:48:04 user nova-compute[74638]:       <entry name="serial">c0f1bb8d-6ad1-4586-bda0-9d6838319e55</entry>
Nov 08 20:48:04 user nova-compute[74638]:       <entry name="uuid">c0f1bb8d-6ad1-4586-bda0-9d6838319e55</entry>
Nov 08 20:48:04 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:48:04 user nova-compute[74638]:     </system>
Nov 08 20:48:04 user nova-compute[74638]:   </sysinfo>
Nov 08 20:48:04 user nova-compute[74638]:   <os>
Nov 08 20:48:04 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:48:04 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:48:04 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:48:04 user nova-compute[74638]:   </os>
Nov 08 20:48:04 user nova-compute[74638]:   <features>
Nov 08 20:48:04 user nova-compute[74638]:     <acpi/>
Nov 08 20:48:04 user nova-compute[74638]:     <apic/>
Nov 08 20:48:04 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:48:04 user nova-compute[74638]:   </features>
Nov 08 20:48:04 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:48:04 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:48:04 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:48:04 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:48:04 user nova-compute[74638]:   </clock>
Nov 08 20:48:04 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:48:04 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:48:04 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:48:04 user nova-compute[74638]:   </cpu>
Nov 08 20:48:04 user nova-compute[74638]:   <devices>
Nov 08 20:48:04 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:48:04 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:48:04 user nova-compute[74638]:       <source dev="/dev/sdb"/>
Nov 08 20:48:04 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:48:04 user nova-compute[74638]:       <serial>9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56</serial>
Nov 08 20:48:04 user nova-compute[74638]:     </disk>
Nov 08 20:48:04 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:48:04 user nova-compute[74638]:       <mac address="fa:16:3e:dd:ab:a2"/>
Nov 08 20:48:04 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:48:04 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:48:04 user nova-compute[74638]:       <target dev="tapdf50b40c-da"/>
Nov 08 20:48:04 user nova-compute[74638]:     </interface>
Nov 08 20:48:04 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:48:04 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/c0f1bb8d-6ad1-4586-bda0-9d6838319e55/console.log" append="off"/>
Nov 08 20:48:04 user nova-compute[74638]:     </serial>
Nov 08 20:48:04 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:48:04 user nova-compute[74638]:     <video>
Nov 08 20:48:04 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:48:04 user nova-compute[74638]:     </video>
Nov 08 20:48:04 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:48:04 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:48:04 user nova-compute[74638]:     </rng>
Nov 08 20:48:04 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:48:04 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:48:04 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:48:04 user nova-compute[74638]:     </memballoon>
Nov 08 20:48:04 user nova-compute[74638]:   </devices>
Nov 08 20:48:04 user nova-compute[74638]: </domain>
Nov 08 20:48:04 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1842722633',display_name='tempest-TestVolumeBootPattern-server-1842722633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1842722633',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-fjh13w1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:47:39Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=c0f1bb8d-6ad1-4586-bda0-9d6838319e55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ab:a2,bridge_name='br-int',has_traffic_filtering=True,id=df50b40c-dacf-455f-baf0-d8a9ebc22fdc,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf50b40c-da') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG os_vif [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ab:a2,bridge_name='br-int',has_traffic_filtering=True,id=df50b40c-dacf-455f-baf0-d8a9ebc22fdc,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf50b40c-da') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d1a1c2d-8c44-50a4-85b9-c5a90ce0caad', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf50b40c-da, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf50b40c-da, col_values=(('qos', UUID('0e5a1efa-bc57-4e9e-a33d-c997d47b05aa')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf50b40c-da, col_values=(('external_ids', {'iface-id': 'df50b40c-dacf-455f-baf0-d8a9ebc22fdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:ab:a2', 'vm-uuid': 'c0f1bb8d-6ad1-4586-bda0-9d6838319e55'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:48:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:04 user nova-compute[74638]: INFO os_vif [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ab:a2,bridge_name='br-int',has_traffic_filtering=True,id=df50b40c-dacf-455f-baf0-d8a9ebc22fdc,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf50b40c-da')
Nov 08 20:48:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:48:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No VIF found with MAC fa:16:3e:dd:ab:a2, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3e7dc88d-9878-44f7-9fb7-78a5196b06a9 req-02ee73e1-9e9e-499b-b79d-80af4c4a001d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3e7dc88d-9878-44f7-9fb7-78a5196b06a9 req-02ee73e1-9e9e-499b-b79d-80af4c4a001d service nova] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3e7dc88d-9878-44f7-9fb7-78a5196b06a9 req-02ee73e1-9e9e-499b-b79d-80af4c4a001d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-3e7dc88d-9878-44f7-9fb7-78a5196b06a9 req-02ee73e1-9e9e-499b-b79d-80af4c4a001d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG nova.compute.manager [req-3e7dc88d-9878-44f7-9fb7-78a5196b06a9 req-02ee73e1-9e9e-499b-b79d-80af4c4a001d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] No waiting events found dispatching network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:48:06 user nova-compute[74638]: WARNING nova.compute.manager [req-3e7dc88d-9878-44f7-9fb7-78a5196b06a9 req-02ee73e1-9e9e-499b-b79d-80af4c4a001d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received unexpected event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc for instance with vm_state building and task_state spawning.
Nov 08 20:48:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:48:08 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Instance spawned successfully.
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-4a4f9731-49e2-4263-a8eb-0089611bfa7d req-ac0b1df2-8805-4453-9de8-e6d9a842bec2 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4a4f9731-49e2-4263-a8eb-0089611bfa7d req-ac0b1df2-8805-4453-9de8-e6d9a842bec2 service nova] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4a4f9731-49e2-4263-a8eb-0089611bfa7d req-ac0b1df2-8805-4453-9de8-e6d9a842bec2 service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-4a4f9731-49e2-4263-a8eb-0089611bfa7d req-ac0b1df2-8805-4453-9de8-e6d9a842bec2 service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.compute.manager [req-4a4f9731-49e2-4263-a8eb-0089611bfa7d req-ac0b1df2-8805-4453-9de8-e6d9a842bec2 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] No waiting events found dispatching network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:48:08 user nova-compute[74638]: WARNING nova.compute.manager [req-4a4f9731-49e2-4263-a8eb-0089611bfa7d req-ac0b1df2-8805-4453-9de8-e6d9a842bec2 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received unexpected event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc for instance with vm_state building and task_state spawning.
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:08 user nova-compute[74638]: INFO nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 08 20:48:08 user nova-compute[74638]: DEBUG nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:48:08 user nova-compute[74638]: INFO nova.compute.manager [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Took 29.73 seconds to build instance.
Nov 08 20:48:08 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-76737243-6404-4459-8dc0-e9330a937e96 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.833s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:10 user nova-compute[74638]: DEBUG nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:48:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:10 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:10 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:48:10 user nova-compute[74638]: INFO nova.compute.claims [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Claim successful on node user
Nov 08 20:48:11 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG nova.network.neutron [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:48:11 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:48:11 user nova-compute[74638]: DEBUG nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG nova.policy [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a47f61da50b04951ac8b351b343b8881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc383d8a631f461fbe2920483635c17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:48:11 user nova-compute[74638]: INFO nova.virt.block_device [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Booting with volume 21210e08-68ab-4ec3-aabc-7c8a72300feb at /dev/vda
Nov 08 20:48:11 user nova-compute[74638]: DEBUG os_brick.utils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f8aa2e-7f3e-4103-911d-5bc40e9afeea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d18cb-918d-4a20-908f-7d19926820aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ee7ae0-1786-4edf-bd6c-b05831ea8e70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[08934833-cdbb-4919-8b2b-87fbbea28531]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:48:11 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:48:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca78e8-8bcb-42fe-9607-c4973b253dcf]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG os_brick.utils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:48:11 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating existing volume attachment record: 9edb8f81-8e4e-4b1b-99e6-79465825908b {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG nova.network.neutron [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Successfully created port: 42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG nova.network.neutron [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Successfully updated port: 42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG nova.network.neutron [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG nova.compute.manager [req-27210250-ac53-4106-8e2f-b6a79e711e4c req-b77d9943-399a-401b-b437-5e1054480c88 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG nova.compute.manager [req-27210250-ac53-4106-8e2f-b6a79e711e4c req-b77d9943-399a-401b-b437-5e1054480c88 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing instance network info cache due to event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-27210250-ac53-4106-8e2f-b6a79e711e4c req-b77d9943-399a-401b-b437-5e1054480c88 service nova] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:48:12 user nova-compute[74638]: DEBUG nova.network.neutron [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:48:13 user nova-compute[74638]: DEBUG nova.network.neutron [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:48:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:48:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance network_info: |[{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:48:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-27210250-ac53-4106-8e2f-b6a79e711e4c req-b77d9943-399a-401b-b437-5e1054480c88 service nova] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:48:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-27210250-ac53-4106-8e2f-b6a79e711e4c req-b77d9943-399a-401b-b437-5e1054480c88 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:48:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-27210250-ac53-4106-8e2f-b6a79e711e4c req-b77d9943-399a-401b-b437-5e1054480c88 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updated VIF entry in instance network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:48:13 user nova-compute[74638]: DEBUG nova.network.neutron [req-27210250-ac53-4106-8e2f-b6a79e711e4c req-b77d9943-399a-401b-b437-5e1054480c88 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:48:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-27210250-ac53-4106-8e2f-b6a79e711e4c req-b77d9943-399a-401b-b437-5e1054480c88 service nova] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:48:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:24 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:27 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:27 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:48:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:31 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:31 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:48:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:48:32 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:48:32 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=25.104896545410156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d8a98545-b288-4b73-bdd3-07492e968a9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c0f1bb8d-6ad1-4586-bda0-9d6838319e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance cecc1165-825d-46d6-be55-81b70cef33c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:48:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:48:33 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Creating image(s)
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Ensure instance console log exists: /opt/stack/data/nova/instances/cecc1165-825d-46d6-be55-81b70cef33c5/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Start _get_guest_xml network_info=[{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '9edb8f81-8e4e-4b1b-99e6-79465825908b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDIkymjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cecc1165-825d-46d6-be55-81b70cef33c5', 'attached_at': '', 'detached_at': '', 'volume_id': '21210e08-68ab-4ec3-aabc-7c8a72300feb', 'serial': '21210e08-68ab-4ec3-aabc-7c8a72300feb'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:48:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:48:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDIkymjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:48:33 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:48:33 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:48:33 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fe16d8-e5c8-4e83-acb1-0186fa79967f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:48:33 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2560296e-2b08-423d-a538-2e7ea4f7a0cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb] added
Nov 08 20:48:33 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a01fd0-666f-4766-bd76-d66622032ebd]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Skipping network cache update for instance because it is Building. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6101c18-0c1f-4e61-a548-0ddb14287b3f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDIkymjl {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDIkymjl" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9328fa-b9fb-4a4f-8b97-03dac8f5fdfa]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YDIkymjl'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid d8a98545-b288-4b73-bdd3-07492e968a9c {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56eb2ac-1d43-4bd6-a477-255fbe6720ce]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eabf6f-0d02-499c-b14d-d93206fda967]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:48:33 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:48:33 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[858d1d1b-fb00-476e-9c1c-f647fadc19d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260]
Nov 08 20:48:33 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260] successful.
Nov 08 20:48:33 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c26d5ba-115f-43ad-aa95-c0b15ef0ee30]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c1dd9b-4e7b-4a43-b71f-2cc1ed712b79]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:48:33 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:48:33 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:48:33 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:48:33 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:48:33 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc29926f-ab4d-4608-9ef0-a4c865495b96]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDIkymjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updating instance_info_cache with network_info: [{"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23138623437623133', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138623437623133', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-347611892',display_name='tempest-TestShelveInstance-server-347611892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-347611892',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN34gALyYu4xvSaffmTvesl2kOx1DGbQyoXHa69YrAD59nifaTPToJM5ZXK5UgzbHHMpUP8a67NGZwwQn1NCyB2shAe9J2TlCQk6cvaAkH9YvDSFDcALQZzv7Y9hoGvPRQ==',key_name='tempest-TestShelveInstance-1320692797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc383d8a631f461fbe2920483635c17a',ramdisk_id='',reservation_id='r-nem41kkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-331524812',owner_user_name='tempest-TestShelveInstance-331524812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:48:11Z,user_data=None,user_id='a47f61da50b04951ac8b351b343b8881',uuid=cecc1165-825d-46d6-be55-81b70cef33c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converting VIF {"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.objects.instance [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lazy-loading 'pci_devices' on Instance uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:48:35 user nova-compute[74638]:   <uuid>cecc1165-825d-46d6-be55-81b70cef33c5</uuid>
Nov 08 20:48:35 user nova-compute[74638]:   <name>instance-00000033</name>
Nov 08 20:48:35 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:48:35 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:48:35 user nova-compute[74638]:   <metadata>
Nov 08 20:48:35 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:48:35 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:48:35 user nova-compute[74638]:       <nova:name>tempest-TestShelveInstance-server-347611892</nova:name>
Nov 08 20:48:35 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:48:33</nova:creationTime>
Nov 08 20:48:35 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:48:35 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:48:35 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:48:35 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:48:35 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:48:35 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:48:35 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:48:35 user nova-compute[74638]:       <nova:owner>
Nov 08 20:48:35 user nova-compute[74638]:         <nova:user uuid="a47f61da50b04951ac8b351b343b8881">tempest-TestShelveInstance-331524812-project-member</nova:user>
Nov 08 20:48:35 user nova-compute[74638]:         <nova:project uuid="cc383d8a631f461fbe2920483635c17a">tempest-TestShelveInstance-331524812</nova:project>
Nov 08 20:48:35 user nova-compute[74638]:       </nova:owner>
Nov 08 20:48:35 user nova-compute[74638]:       <nova:ports>
Nov 08 20:48:35 user nova-compute[74638]:         <nova:port uuid="42676bb9-c900-4125-9f52-5417288ef2c7">
Nov 08 20:48:35 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 20:48:35 user nova-compute[74638]:         </nova:port>
Nov 08 20:48:35 user nova-compute[74638]:       </nova:ports>
Nov 08 20:48:35 user nova-compute[74638]:     </nova:instance>
Nov 08 20:48:35 user nova-compute[74638]:   </metadata>
Nov 08 20:48:35 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:48:35 user nova-compute[74638]:     <system>
Nov 08 20:48:35 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:48:35 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:48:35 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:48:35 user nova-compute[74638]:       <entry name="serial">cecc1165-825d-46d6-be55-81b70cef33c5</entry>
Nov 08 20:48:35 user nova-compute[74638]:       <entry name="uuid">cecc1165-825d-46d6-be55-81b70cef33c5</entry>
Nov 08 20:48:35 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:48:35 user nova-compute[74638]:     </system>
Nov 08 20:48:35 user nova-compute[74638]:   </sysinfo>
Nov 08 20:48:35 user nova-compute[74638]:   <os>
Nov 08 20:48:35 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:48:35 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:48:35 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:48:35 user nova-compute[74638]:   </os>
Nov 08 20:48:35 user nova-compute[74638]:   <features>
Nov 08 20:48:35 user nova-compute[74638]:     <acpi/>
Nov 08 20:48:35 user nova-compute[74638]:     <apic/>
Nov 08 20:48:35 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:48:35 user nova-compute[74638]:   </features>
Nov 08 20:48:35 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:48:35 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:48:35 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:48:35 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:48:35 user nova-compute[74638]:   </clock>
Nov 08 20:48:35 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:48:35 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:48:35 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:48:35 user nova-compute[74638]:   </cpu>
Nov 08 20:48:35 user nova-compute[74638]:   <devices>
Nov 08 20:48:35 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:48:35 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:48:35 user nova-compute[74638]:       <source dev="/dev/sdc"/>
Nov 08 20:48:35 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:48:35 user nova-compute[74638]:       <serial>21210e08-68ab-4ec3-aabc-7c8a72300feb</serial>
Nov 08 20:48:35 user nova-compute[74638]:     </disk>
Nov 08 20:48:35 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:48:35 user nova-compute[74638]:       <mac address="fa:16:3e:9e:4d:eb"/>
Nov 08 20:48:35 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:48:35 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:48:35 user nova-compute[74638]:       <target dev="tap42676bb9-c9"/>
Nov 08 20:48:35 user nova-compute[74638]:     </interface>
Nov 08 20:48:35 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:48:35 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/cecc1165-825d-46d6-be55-81b70cef33c5/console.log" append="off"/>
Nov 08 20:48:35 user nova-compute[74638]:     </serial>
Nov 08 20:48:35 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:48:35 user nova-compute[74638]:     <video>
Nov 08 20:48:35 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:48:35 user nova-compute[74638]:     </video>
Nov 08 20:48:35 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:48:35 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:48:35 user nova-compute[74638]:     </rng>
Nov 08 20:48:35 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:48:35 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:48:35 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:48:35 user nova-compute[74638]:     </memballoon>
Nov 08 20:48:35 user nova-compute[74638]:   </devices>
Nov 08 20:48:35 user nova-compute[74638]: </domain>
Nov 08 20:48:35 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-347611892',display_name='tempest-TestShelveInstance-server-347611892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-347611892',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN34gALyYu4xvSaffmTvesl2kOx1DGbQyoXHa69YrAD59nifaTPToJM5ZXK5UgzbHHMpUP8a67NGZwwQn1NCyB2shAe9J2TlCQk6cvaAkH9YvDSFDcALQZzv7Y9hoGvPRQ==',key_name='tempest-TestShelveInstance-1320692797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc383d8a631f461fbe2920483635c17a',ramdisk_id='',reservation_id='r-nem41kkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-331524812',owner_user_name='tempest-TestShelveInstance-331524812-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:48:11Z,user_data=None,user_id='a47f61da50b04951ac8b351b343b8881',uuid=cecc1165-825d-46d6-be55-81b70cef33c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converting VIF {"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG os_vif [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e7b1053-b1f5-5c90-b81d-10c17deca749', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42676bb9-c9, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42676bb9-c9, col_values=(('qos', UUID('b6086040-e801-4d24-ac35-4b353f72c564')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42676bb9-c9, col_values=(('external_ids', {'iface-id': '42676bb9-c900-4125-9f52-5417288ef2c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:4d:eb', 'vm-uuid': 'cecc1165-825d-46d6-be55-81b70cef33c5'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:35 user nova-compute[74638]: INFO os_vif [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9')
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] No VIF found with MAC fa:16:3e:9e:4d:eb, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-c9f2e7a4-b228-4edc-b4bf-227bd61d9442 req-b0a46382-f4fa-4077-9fd9-15ef4736858d service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9f2e7a4-b228-4edc-b4bf-227bd61d9442 req-b0a46382-f4fa-4077-9fd9-15ef4736858d service nova] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9f2e7a4-b228-4edc-b4bf-227bd61d9442 req-b0a46382-f4fa-4077-9fd9-15ef4736858d service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-c9f2e7a4-b228-4edc-b4bf-227bd61d9442 req-b0a46382-f4fa-4077-9fd9-15ef4736858d service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG nova.compute.manager [req-c9f2e7a4-b228-4edc-b4bf-227bd61d9442 req-b0a46382-f4fa-4077-9fd9-15ef4736858d service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] No waiting events found dispatching network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:48:36 user nova-compute[74638]: WARNING nova.compute.manager [req-c9f2e7a4-b228-4edc-b4bf-227bd61d9442 req-b0a46382-f4fa-4077-9fd9-15ef4736858d service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received unexpected event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 for instance with vm_state building and task_state spawning.
Nov 08 20:48:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:37 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:48:38 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance spawned successfully.
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:48:38 user nova-compute[74638]: INFO nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.compute.manager [req-e617736c-c42d-45f4-a067-3c0d8b234962 req-26018ccc-ebf6-4dfd-a454-26bc12335207 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e617736c-c42d-45f4-a067-3c0d8b234962 req-26018ccc-ebf6-4dfd-a454-26bc12335207 service nova] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e617736c-c42d-45f4-a067-3c0d8b234962 req-26018ccc-ebf6-4dfd-a454-26bc12335207 service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e617736c-c42d-45f4-a067-3c0d8b234962 req-26018ccc-ebf6-4dfd-a454-26bc12335207 service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:38 user nova-compute[74638]: DEBUG nova.compute.manager [req-e617736c-c42d-45f4-a067-3c0d8b234962 req-26018ccc-ebf6-4dfd-a454-26bc12335207 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] No waiting events found dispatching network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:48:38 user nova-compute[74638]: WARNING nova.compute.manager [req-e617736c-c42d-45f4-a067-3c0d8b234962 req-26018ccc-ebf6-4dfd-a454-26bc12335207 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received unexpected event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 for instance with vm_state building and task_state spawning.
Nov 08 20:48:38 user nova-compute[74638]: INFO nova.compute.manager [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Took 27.82 seconds to build instance.
Nov 08 20:48:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-13e8a2ca-ec87-4839-8e08-5c57602f3947 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.915s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:40 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:48:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-5bf7dc58-f73b-4bd5-9e19-8349da4cf0a7 req-151a400a-1e0e-4e9b-8478-0ddfba5dcd0d service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received event network-changed-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:48:41 user nova-compute[74638]: DEBUG nova.compute.manager [req-5bf7dc58-f73b-4bd5-9e19-8349da4cf0a7 req-151a400a-1e0e-4e9b-8478-0ddfba5dcd0d service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Refreshing instance network info cache due to event network-changed-68286e42-0782-479d-b073-b0f9fa35c087. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:48:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5bf7dc58-f73b-4bd5-9e19-8349da4cf0a7 req-151a400a-1e0e-4e9b-8478-0ddfba5dcd0d service nova] Acquiring lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:48:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5bf7dc58-f73b-4bd5-9e19-8349da4cf0a7 req-151a400a-1e0e-4e9b-8478-0ddfba5dcd0d service nova] Acquired lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:48:41 user nova-compute[74638]: DEBUG nova.network.neutron [req-5bf7dc58-f73b-4bd5-9e19-8349da4cf0a7 req-151a400a-1e0e-4e9b-8478-0ddfba5dcd0d service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Refreshing network info cache for port 68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:48:42 user nova-compute[74638]: DEBUG nova.network.neutron [req-5bf7dc58-f73b-4bd5-9e19-8349da4cf0a7 req-151a400a-1e0e-4e9b-8478-0ddfba5dcd0d service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updated VIF entry in instance network info cache for port 68286e42-0782-479d-b073-b0f9fa35c087. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:48:42 user nova-compute[74638]: DEBUG nova.network.neutron [req-5bf7dc58-f73b-4bd5-9e19-8349da4cf0a7 req-151a400a-1e0e-4e9b-8478-0ddfba5dcd0d service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updating instance_info_cache with network_info: [{"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:48:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5bf7dc58-f73b-4bd5-9e19-8349da4cf0a7 req-151a400a-1e0e-4e9b-8478-0ddfba5dcd0d service nova] Releasing lock "refresh_cache-d8a98545-b288-4b73-bdd3-07492e968a9c" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:48:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG nova.objects.instance [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid d8a98545-b288-4b73-bdd3-07492e968a9c {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:48:48 user nova-compute[74638]: INFO nova.compute.manager [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Attaching volume d4d15b49-fcbf-447d-85bc-1346a5a3696f to /dev/vdb
Nov 08 20:48:48 user nova-compute[74638]: DEBUG os_brick.utils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb948ee-2ec5-43a6-ac68-7a49b3e77773]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a03489-b72a-4e61-9092-8564ea8c088b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:48 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad59a5c4-1154-4236-85af-4a20b1a181ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c889634f-6d52-4d49-8d42-f72ca9296507]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:48:49 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:48:49 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e662e72d-fb14-444b-a08f-1288dfb74757]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG os_brick.utils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updating existing volume attachment record: 0165a98d-5149-43ed-ab3b-1c331dbec5ce {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:48:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:48:59 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMTjIlqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:49:11 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:49:11 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:49:11 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda12acf-e33e-441c-a86a-b9f1beb4222c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:49:11 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d88605-f7c1-4624-afc9-0b7080c6b457]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f] added
Nov 08 20:49:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[03984ca1-3d83-4df3-a501-8cb691ef383f]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaafa0a5-b613-4d39-ac72-9bc1670ed727]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMTjIlqU {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMTjIlqU" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5732ba2-7464-42b0-8cde-5a1b074fef88]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMTjIlqU'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a797ac-3fe4-472c-bd0f-9ac5b8ca5035]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c68a63-9f7a-4c93-84e1-fd10a7067773]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:49:11 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:49:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:49:11 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:49:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bba08f-b2a1-46d4-a6c0-6dc265a55d87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f, portal: 172.16.0.220,3260]
Nov 08 20:49:11 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f, portal: 172.16.0.220,3260] successful.
Nov 08 20:49:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fb3ea4-ead8-4118-b5a2-f54be29e475e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af2fc5f-36d5-4dee-98ea-8176b53aeeb2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:49:11 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:49:11 user nova-compute[74638]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f (non-flash)
Nov 08 20:49:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:49:11 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:49:11 user nova-compute[74638]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f (non-flash)
Nov 08 20:49:11 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6436cc-a7de-42a8-8726-cbf7605365db]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:11 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:49:12 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:49:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMTjIlqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:49:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:49:12 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23765326638303266', 'path': '/dev/sdd'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:49:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765326638303266', 'path': '/dev/sdd'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:49:12 user nova-compute[74638]: DEBUG nova.objects.instance [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid d8a98545-b288-4b73-bdd3-07492e968a9c {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:49:12 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 20:49:12 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:49:12 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:49:12 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:49:12 user nova-compute[74638]:   <serial>d4d15b49-fcbf-447d-85bc-1346a5a3696f</serial>
Nov 08 20:49:12 user nova-compute[74638]: </disk>
Nov 08 20:49:12 user nova-compute[74638]:  {{(pid=74638) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 20:49:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:49:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:49:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] No VIF found with MAC fa:16:3e:4d:ea:43, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:49:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-b4faec23-56f8-4cd5-8fec-ed8bfd1406b4 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.628s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:49:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:49:14 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:49:14 user nova-compute[74638]: INFO nova.compute.manager [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Detaching volume d4d15b49-fcbf-447d-85bc-1346a5a3696f
Nov 08 20:49:15 user nova-compute[74638]: INFO nova.virt.block_device [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Attempting to driver detach volume d4d15b49-fcbf-447d-85bc-1346a5a3696f from mountpoint /dev/vdb
Nov 08 20:49:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Attempting to detach device vdb from instance d8a98545-b288-4b73-bdd3-07492e968a9c from the persistent domain config. {{(pid=74638) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 20:49:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:49:15 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:49:15 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:49:15 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:49:15 user nova-compute[74638]:   <serial>d4d15b49-fcbf-447d-85bc-1346a5a3696f</serial>
Nov 08 20:49:15 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:49:15 user nova-compute[74638]: </disk>
Nov 08 20:49:15 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:49:15 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully detached device vdb from instance d8a98545-b288-4b73-bdd3-07492e968a9c from the persistent domain config.
Nov 08 20:49:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8a98545-b288-4b73-bdd3-07492e968a9c from the live domain config. {{(pid=74638) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 20:49:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.guest [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 20:49:15 user nova-compute[74638]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:49:15 user nova-compute[74638]:   <source dev="/dev/sdd"/>
Nov 08 20:49:15 user nova-compute[74638]:   <target dev="vdb" bus="virtio"/>
Nov 08 20:49:15 user nova-compute[74638]:   <serial>d4d15b49-fcbf-447d-85bc-1346a5a3696f</serial>
Nov 08 20:49:15 user nova-compute[74638]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 20:49:15 user nova-compute[74638]: </disk>
Nov 08 20:49:15 user nova-compute[74638]:  {{(pid=74638) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 20:49:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8a98545-b288-4b73-bdd3-07492e968a9c {{(pid=74638) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 20:49:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:26 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:28 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:29 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:49:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-e79479d4-69af-4421-8031-19f961fbeb1a req-085e1408-335e-4229-8f93-1c0ff6a4e70e service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-changed-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:49:30 user nova-compute[74638]: DEBUG nova.compute.manager [req-e79479d4-69af-4421-8031-19f961fbeb1a req-085e1408-335e-4229-8f93-1c0ff6a4e70e service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Refreshing instance network info cache due to event network-changed-df50b40c-dacf-455f-baf0-d8a9ebc22fdc. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:49:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e79479d4-69af-4421-8031-19f961fbeb1a req-085e1408-335e-4229-8f93-1c0ff6a4e70e service nova] Acquiring lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:49:30 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e79479d4-69af-4421-8031-19f961fbeb1a req-085e1408-335e-4229-8f93-1c0ff6a4e70e service nova] Acquired lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:49:30 user nova-compute[74638]: DEBUG nova.network.neutron [req-e79479d4-69af-4421-8031-19f961fbeb1a req-085e1408-335e-4229-8f93-1c0ff6a4e70e service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Refreshing network info cache for port df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG nova.network.neutron [req-e79479d4-69af-4421-8031-19f961fbeb1a req-085e1408-335e-4229-8f93-1c0ff6a4e70e service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updated VIF entry in instance network info cache for port df50b40c-dacf-455f-baf0-d8a9ebc22fdc. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG nova.network.neutron [req-e79479d4-69af-4421-8031-19f961fbeb1a req-085e1408-335e-4229-8f93-1c0ff6a4e70e service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating instance_info_cache with network_info: [{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e79479d4-69af-4421-8031-19f961fbeb1a req-085e1408-335e-4229-8f93-1c0ff6a4e70e service nova] Releasing lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:31 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:49:32 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:49:32 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=25.102802276611328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance d8a98545-b288-4b73-bdd3-07492e968a9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c0f1bb8d-6ad1-4586-bda0-9d6838319e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance cecc1165-825d-46d6-be55-81b70cef33c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:49:32 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:49:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:35 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8a98545-b288-4b73-bdd3-07492e968a9c is timed out.
Nov 08 20:49:35 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully detached device vdb from instance d8a98545-b288-4b73-bdd3-07492e968a9c from the live domain config.
Nov 08 20:49:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMTjIlqU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:49:35 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3666208f-c87a-4352-afa5-de78f8dcc36e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:49:35 user nova-compute[74638]: No targets found.
Nov 08 20:49:35 user nova-compute[74638]: iSNS:
Nov 08 20:49:35 user nova-compute[74638]: No targets found.
Nov 08 20:49:35 user nova-compute[74638]: STATIC:
Nov 08 20:49:35 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f
Nov 08 20:49:35 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:49:35 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:49:35 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb
Nov 08 20:49:35 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:49:35 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:49:35 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56
Nov 08 20:49:35 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:49:35 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:49:35 user nova-compute[74638]: FIRMWARE:
Nov 08 20:49:35 user nova-compute[74638]: No targets found.
Nov 08 20:49:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:49:35 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:49:35 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0360f6b-2a70-43de-818e-d7fa392a711a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[347ea9ae-41e8-4308-8d2b-874fc35aabb7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:49:35 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:49:35 user nova-compute[74638]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f (non-flash)
Nov 08 20:49:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:49:35 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:49:35 user nova-compute[74638]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f (non-flash)
Nov 08 20:49:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c496b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f'): ({'sdd'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Removing single pathed devices sdd {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c07d2-b803-48b3-8784-096f9949ed06]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7d3b20-6b41-4d88-9494-4b82e849edb0]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Flushing IO for device /dev/sdd {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e0431e-bd37-48e1-a3f8-6af23a34bcdf]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d5a4c-a507-48c4-a6b8-05a485ec5951]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] SCSI volumes sdd have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8447cf-bd72-45b1-8d70-d078e40cb56e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[79395e71-5a06-477e-92b8-f02f98ffe85a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f, portal: 172.16.0.220,3260]
Nov 08 20:49:35 user nova-compute[74638]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f, portal: 172.16.0.220,3260] successful.
Nov 08 20:49:35 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4d15b49-fcbf-447d-85bc-1346a5a3696f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba59213e-660c-4dcd-ba8b-444305231b59]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] <== disconnect_volume: return (299ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:49:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:49:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating instance_info_cache with network_info: [{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:49:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:49:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:49:36 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:36 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:36 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:49:36 user nova-compute[74638]: DEBUG nova.objects.instance [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'flavor' on Instance uuid d8a98545-b288-4b73-bdd3-07492e968a9c {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:49:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-dd318163-0cb8-4d3c-96aa-d3f0ffe58467 tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.811s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:49:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:49:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Starting instance... {{(pid=74638) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:49:50 user nova-compute[74638]: INFO nova.compute.claims [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Claim successful on node user
Nov 08 20:49:50 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Start building networks asynchronously for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Allocating IP information in the background. {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 20:49:50 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] allocate_for_instance() {{(pid=74638) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 20:49:50 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 20:49:50 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Start building block device mappings for instance. {{(pid=74638) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG nova.policy [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63d3b55213f44fbb4dd76758a9a61ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e599a20be834415ea60230b8743a2338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74638) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 20:49:51 user nova-compute[74638]: INFO nova.virt.block_device [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Booting with volume 57870941-f960-4516-ab58-50cd43b362e3 at /dev/vda
Nov 08 20:49:51 user nova-compute[74638]: DEBUG os_brick.utils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[80acb758-ccca-4ac4-b350-d7e0f09f4db1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b4e54-47e8-4464-a2b6-4893edf9fe8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[694fe27a-cf92-4fc4-98a2-1ba7ae1747d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[791e0821-e39d-461f-b5bc-da73a4d4784a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:49:51 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:49:51 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cf305f-f598-4cd6-85a4-9a6447cd78df]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG os_brick.utils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updating existing volume attachment record: b10b0af1-445d-49e3-8f52-b2d1852d778a {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:49:51 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Successfully created port: 3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Successfully updated port: 3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquired lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Instance cache missing network info. {{(pid=74638) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-6097d261-c877-40df-a149-094564ea3700 req-bfb0a11c-cce2-42c0-a9de-104b289cea49 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-changed-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG nova.compute.manager [req-6097d261-c877-40df-a149-094564ea3700 req-bfb0a11c-cce2-42c0-a9de-104b289cea49 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Refreshing instance network info cache due to event network-changed-3b519614-fbc6-46be-805d-a694e0e155a0. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6097d261-c877-40df-a149-094564ea3700 req-bfb0a11c-cce2-42c0-a9de-104b289cea49 service nova] Acquiring lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updating instance_info_cache with network_info: [{"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Releasing lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Instance network_info: |[{"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74638) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6097d261-c877-40df-a149-094564ea3700 req-bfb0a11c-cce2-42c0-a9de-104b289cea49 service nova] Acquired lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:49:52 user nova-compute[74638]: DEBUG nova.network.neutron [req-6097d261-c877-40df-a149-094564ea3700 req-bfb0a11c-cce2-42c0-a9de-104b289cea49 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Refreshing network info cache for port 3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:49:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-6097d261-c877-40df-a149-094564ea3700 req-bfb0a11c-cce2-42c0-a9de-104b289cea49 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updated VIF entry in instance network info cache for port 3b519614-fbc6-46be-805d-a694e0e155a0. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:49:53 user nova-compute[74638]: DEBUG nova.network.neutron [req-6097d261-c877-40df-a149-094564ea3700 req-bfb0a11c-cce2-42c0-a9de-104b289cea49 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updating instance_info_cache with network_info: [{"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:49:53 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-6097d261-c877-40df-a149-094564ea3700 req-bfb0a11c-cce2-42c0-a9de-104b289cea49 service nova] Releasing lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:49:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-5142ef00-e1c6-40bc-af52-5d75e7eccb10 req-ca2c786b-e422-478f-8e81-d6b2a97f6717 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-5142ef00-e1c6-40bc-af52-5d75e7eccb10 req-ca2c786b-e422-478f-8e81-d6b2a97f6717 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing instance network info cache due to event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5142ef00-e1c6-40bc-af52-5d75e7eccb10 req-ca2c786b-e422-478f-8e81-d6b2a97f6717 service nova] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5142ef00-e1c6-40bc-af52-5d75e7eccb10 req-ca2c786b-e422-478f-8e81-d6b2a97f6717 service nova] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG nova.network.neutron [req-5142ef00-e1c6-40bc-af52-5d75e7eccb10 req-ca2c786b-e422-478f-8e81-d6b2a97f6717 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG nova.network.neutron [req-5142ef00-e1c6-40bc-af52-5d75e7eccb10 req-ca2c786b-e422-478f-8e81-d6b2a97f6717 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updated VIF entry in instance network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG nova.network.neutron [req-5142ef00-e1c6-40bc-af52-5d75e7eccb10 req-ca2c786b-e422-478f-8e81-d6b2a97f6717 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5142ef00-e1c6-40bc-af52-5d75e7eccb10 req-ca2c786b-e422-478f-8e81-d6b2a97f6717 service nova] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:03 user nova-compute[74638]: INFO nova.compute.manager [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Shelve offloading
Nov 08 20:50:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-ce15616e-2029-4113-8efa-90c9b045ade3 req-94235568-b601-4442-a6a9-c49369cedb3a service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-unplugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ce15616e-2029-4113-8efa-90c9b045ade3 req-94235568-b601-4442-a6a9-c49369cedb3a service nova] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ce15616e-2029-4113-8efa-90c9b045ade3 req-94235568-b601-4442-a6a9-c49369cedb3a service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ce15616e-2029-4113-8efa-90c9b045ade3 req-94235568-b601-4442-a6a9-c49369cedb3a service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:03 user nova-compute[74638]: DEBUG nova.compute.manager [req-ce15616e-2029-4113-8efa-90c9b045ade3 req-94235568-b601-4442-a6a9-c49369cedb3a service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] No waiting events found dispatching network-vif-unplugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:50:03 user nova-compute[74638]: WARNING nova.compute.manager [req-ce15616e-2029-4113-8efa-90c9b045ade3 req-94235568-b601-4442-a6a9-c49369cedb3a service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received unexpected event network-vif-unplugged-42676bb9-c900-4125-9f52-5417288ef2c7 for instance with vm_state active and task_state shelving.
Nov 08 20:50:04 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance destroyed successfully.
Nov 08 20:50:04 user nova-compute[74638]: DEBUG nova.compute.manager [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:50:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:50:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:50:04 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:50:04 user nova-compute[74638]: DEBUG nova.network.neutron [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:50:04 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:50:04 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:05 user nova-compute[74638]: INFO nova.compute.manager [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Terminating instance
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:50:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance destroyed successfully.
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lazy-loading 'resources' on Instance uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-347611892',display_name='tempest-TestShelveInstance-server-347611892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-347611892',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN34gALyYu4xvSaffmTvesl2kOx1DGbQyoXHa69YrAD59nifaTPToJM5ZXK5UgzbHHMpUP8a67NGZwwQn1NCyB2shAe9J2TlCQk6cvaAkH9YvDSFDcALQZzv7Y9hoGvPRQ==',key_name='tempest-TestShelveInstance-1320692797',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc383d8a631f461fbe2920483635c17a',ramdisk_id='',reservation_id='r-nem41kkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-331524812',owner_user_name='tempest-TestShelveInstance-331524812-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:48:39Z,user_data=None,user_id='a47f61da50b04951ac8b351b343b8881',uuid=cecc1165-825d-46d6-be55-81b70cef33c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converting VIF {"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_vif [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42676bb9-c9, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-befc71e2-9724-4045-9f6d-264e77409a4b req-363daeb8-ff4a-45fe-83cb-5f9941270019 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-befc71e2-9724-4045-9f6d-264e77409a4b req-363daeb8-ff4a-45fe-83cb-5f9941270019 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing instance network info cache due to event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-befc71e2-9724-4045-9f6d-264e77409a4b req-363daeb8-ff4a-45fe-83cb-5f9941270019 service nova] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-befc71e2-9724-4045-9f6d-264e77409a4b req-363daeb8-ff4a-45fe-83cb-5f9941270019 service nova] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.network.neutron [req-befc71e2-9724-4045-9f6d-264e77409a4b req-363daeb8-ff4a-45fe-83cb-5f9941270019 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6086040-e801-4d24-ac35-4b353f72c564) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: INFO os_vif [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9')
Nov 08 20:50:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDIkymjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:50:05 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8aedf3-fec9-41f1-8a03-0afca9af467f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:50:05 user nova-compute[74638]: No targets found.
Nov 08 20:50:05 user nova-compute[74638]: iSNS:
Nov 08 20:50:05 user nova-compute[74638]: No targets found.
Nov 08 20:50:05 user nova-compute[74638]: STATIC:
Nov 08 20:50:05 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb
Nov 08 20:50:05 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:50:05 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:50:05 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56
Nov 08 20:50:05 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:50:05 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:50:05 user nova-compute[74638]: FIRMWARE:
Nov 08 20:50:05 user nova-compute[74638]: No targets found.
Nov 08 20:50:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:50:05 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:50:05 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[27090813-edc6-4508-baff-9bec928d0313]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[68209a0e-7332-4418-9897-ed9adefc2514]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:50:05 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:50:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:50:05 user nova-compute[74638]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:50:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe54c06d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2875c8-0d67-4bbe-adf9-d8a48058cc92]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf9bd1-d04f-4ff4-b811-5c7b1f04842d]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ca71a1-e518-4d78-b305-17c9ed87562a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0773b95f-43fc-4d5a-98e5-693e2aae9565]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d0cbd-8396-4fe1-b373-9cd1b79fd0a0]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] No waiting events found dispatching network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:50:05 user nova-compute[74638]: WARNING nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received unexpected event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 for instance with vm_state active and task_state shelving.
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received event network-vif-unplugged-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] No waiting events found dispatching network-vif-unplugged-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received event network-vif-unplugged-68286e42-0782-479d-b073-b0f9fa35c087 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received event network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Acquiring lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] No waiting events found dispatching network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:50:05 user nova-compute[74638]: WARNING nova.compute.manager [req-e9d79e60-8bee-4a7d-9bb6-9e4fc6a19c9c req-0aa462b0-5732-4f5d-8c3e-8c036a6d768b service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received unexpected event network-vif-plugged-68286e42-0782-479d-b073-b0f9fa35c087 for instance with vm_state active and task_state deleting.
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e45e91-bc67-44d8-a78e-692b8d21949b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260]
Nov 08 20:50:05 user nova-compute[74638]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260] successful.
Nov 08 20:50:05 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c19188c-233f-4418-a8d7-e7c583ba4eac]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] <== disconnect_volume: return (373ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:50:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Deleting instance files /opt/stack/data/nova/instances/cecc1165-825d-46d6-be55-81b70cef33c5_del
Nov 08 20:50:05 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Deletion of /opt/stack/data/nova/instances/cecc1165-825d-46d6-be55-81b70cef33c5_del complete
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.network.neutron [req-befc71e2-9724-4045-9f6d-264e77409a4b req-363daeb8-ff4a-45fe-83cb-5f9941270019 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updated VIF entry in instance network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG nova.network.neutron [req-befc71e2-9724-4045-9f6d-264e77409a4b req-363daeb8-ff4a-45fe-83cb-5f9941270019 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": null, "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap42676bb9-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:50:05 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-befc71e2-9724-4045-9f6d-264e77409a4b req-363daeb8-ff4a-45fe-83cb-5f9941270019 service nova] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:50:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Instance destroyed successfully.
Nov 08 20:50:06 user nova-compute[74638]: DEBUG nova.objects.instance [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lazy-loading 'resources' on Instance uuid d8a98545-b288-4b73-bdd3-07492e968a9c {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-434568106',display_name='tempest-AttachVolumeNegativeTest-server-434568106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-434568106',id=49,image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRJMGpoJluA7oRLjaNq7iuj1CusW5elJ86QUH4CSiyXodaYA5U4CvTFKsGzZvAl1jJceZl86tFWZEqlhAswpar1wbhddLtlO5F11K89MQrGSuTc9rsrRckM48IzuPkW2A==',key_name='tempest-keypair-943853309',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a349308d9cb9419f9981a9d28ea61248',ramdisk_id='',reservation_id='r-3juuqz00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2378b081-1a49-4717-81bb-a291ba1a9d32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1913966386',owner_user_name='tempest-AttachVolumeNegativeTest-1913966386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:46:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55df27e8271941e8ac7825d6999ce486',uuid=d8a98545-b288-4b73-bdd3-07492e968a9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converting VIF {"id": "68286e42-0782-479d-b073-b0f9fa35c087", "address": "fa:16:3e:4d:ea:43", "network": {"id": "de54eb36-0bf2-4f3a-8976-55578566c03d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2035083098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a349308d9cb9419f9981a9d28ea61248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68286e42-07", "ovs_interfaceid": "68286e42-0782-479d-b073-b0f9fa35c087", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ea:43,bridge_name='br-int',has_traffic_filtering=True,id=68286e42-0782-479d-b073-b0f9fa35c087,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286e42-07') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG os_vif [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ea:43,bridge_name='br-int',has_traffic_filtering=True,id=68286e42-0782-479d-b073-b0f9fa35c087,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286e42-07') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68286e42-07, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cc9075e-201d-4ab1-a53c-340394c714b1) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:50:06 user nova-compute[74638]: INFO os_vif [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ea:43,bridge_name='br-int',has_traffic_filtering=True,id=68286e42-0782-479d-b073-b0f9fa35c087,network=Network(de54eb36-0bf2-4f3a-8976-55578566c03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68286e42-07')
Nov 08 20:50:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Deleting instance files /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c_del
Nov 08 20:50:06 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Deletion of /opt/stack/data/nova/instances/d8a98545-b288-4b73-bdd3-07492e968a9c_del complete
Nov 08 20:50:06 user nova-compute[74638]: INFO nova.compute.manager [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 20:50:06 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:50:06 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Took 0.66 seconds to deallocate network for instance.
Nov 08 20:50:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:06 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:50:07 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Deleted allocations for instance cecc1165-825d-46d6-be55-81b70cef33c5
Nov 08 20:50:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:07 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Deleted allocations for instance d8a98545-b288-4b73-bdd3-07492e968a9c
Nov 08 20:50:07 user nova-compute[74638]: DEBUG nova.objects.instance [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lazy-loading 'numa_topology' on Instance uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG nova.objects.base [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Object Instance<cecc1165-825d-46d6-be55-81b70cef33c5> lazy-loaded attributes: resources,numa_topology {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-6dae5749-a1e0-4b43-b3cd-57601f87cefb tempest-AttachVolumeNegativeTest-1913966386 tempest-AttachVolumeNegativeTest-1913966386-project-member] Lock "d8a98545-b288-4b73-bdd3-07492e968a9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.948s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-c641d17c-8bba-4998-94d5-3d046132b933 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.907s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:07 user nova-compute[74638]: DEBUG nova.compute.manager [req-0a61babc-47f6-4b40-9020-155533063484 req-e92664a6-6b76-4180-9b5d-28a14e0d3d5a service nova] [instance: d8a98545-b288-4b73-bdd3-07492e968a9c] Received event network-vif-deleted-68286e42-0782-479d-b073-b0f9fa35c087 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Start spawning the instance on the hypervisor. {{(pid=74638) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:50:13 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Creating image(s)
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Ensure instance console log exists: /opt/stack/data/nova/instances/909c28c9-efce-40d1-8f66-c8d0d6643503/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Start _get_guest_xml network_info=[{"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'b10b0af1-445d-49e3-8f52-b2d1852d778a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaMzNuFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '909c28c9-efce-40d1-8f66-c8d0d6643503', 'attached_at': '', 'detached_at': '', 'volume_id': '57870941-f960-4516-ab58-50cd43b362e3', 'serial': '57870941-f960-4516-ab58-50cd43b362e3'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:50:13 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:50:13 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaMzNuFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:50:13 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:50:13 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:50:13 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c25a4b-2fe6-472e-b302-960f44b5d53a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:50:13 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00f0535-bb55-45e7-9c1e-a9ae11905b8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3] added
Nov 08 20:50:13 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d6661-3c97-4809-b487-7f629ae56122]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61bd401-2b89-40a2-8eff-00d3772ae700]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaMzNuFR {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaMzNuFR" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b007fa-faad-4336-bff4-31d149cec25c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JaMzNuFR'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48726e9-d10f-4bbe-ab5b-5462c4856a0e]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:13 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c9b14-c041-45d5-be4a-79225078b0ba]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:50:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:50:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e26a5fa-06e9-4f5f-94f6-93e488fae7cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3, portal: 172.16.0.220,3260]
Nov 08 20:50:14 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3, portal: 172.16.0.220,3260] successful.
Nov 08 20:50:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bc78ee-1616-438c-b881-bb5594beb050]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe74125a-ea9f-43b3-a196-d42429127811]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:50:14 user nova-compute[74638]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 (non-flash)
Nov 08 20:50:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:50:14 user nova-compute[74638]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 (non-flash)
Nov 08 20:50:14 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c39233-ea2a-42a2-a7fc-72020a252a85]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:50:14 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaMzNuFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23031363839373465', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031363839373465', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422126050',display_name='tempest-TestVolumeBootPattern-server-422126050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422126050',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-2vofyz13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:49:51Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=909c28c9-efce-40d1-8f66-c8d0d6643503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b519614-fbc6-46be-805d-a694e0e155a0,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b519614-fb') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'pci_devices' on Instance uuid 909c28c9-efce-40d1-8f66-c8d0d6643503 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:50:15 user nova-compute[74638]:   <uuid>909c28c9-efce-40d1-8f66-c8d0d6643503</uuid>
Nov 08 20:50:15 user nova-compute[74638]:   <name>instance-00000034</name>
Nov 08 20:50:15 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:50:15 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:50:15 user nova-compute[74638]:   <metadata>
Nov 08 20:50:15 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:50:15 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:50:15 user nova-compute[74638]:       <nova:name>tempest-TestVolumeBootPattern-server-422126050</nova:name>
Nov 08 20:50:15 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:50:13</nova:creationTime>
Nov 08 20:50:15 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:50:15 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:50:15 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:50:15 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:50:15 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:50:15 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:50:15 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:50:15 user nova-compute[74638]:       <nova:owner>
Nov 08 20:50:15 user nova-compute[74638]:         <nova:user uuid="f63d3b55213f44fbb4dd76758a9a61ed">tempest-TestVolumeBootPattern-1116596406-project-member</nova:user>
Nov 08 20:50:15 user nova-compute[74638]:         <nova:project uuid="e599a20be834415ea60230b8743a2338">tempest-TestVolumeBootPattern-1116596406</nova:project>
Nov 08 20:50:15 user nova-compute[74638]:       </nova:owner>
Nov 08 20:50:15 user nova-compute[74638]:       <nova:ports>
Nov 08 20:50:15 user nova-compute[74638]:         <nova:port uuid="3b519614-fbc6-46be-805d-a694e0e155a0">
Nov 08 20:50:15 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 20:50:15 user nova-compute[74638]:         </nova:port>
Nov 08 20:50:15 user nova-compute[74638]:       </nova:ports>
Nov 08 20:50:15 user nova-compute[74638]:     </nova:instance>
Nov 08 20:50:15 user nova-compute[74638]:   </metadata>
Nov 08 20:50:15 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:50:15 user nova-compute[74638]:     <system>
Nov 08 20:50:15 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:50:15 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:50:15 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:50:15 user nova-compute[74638]:       <entry name="serial">909c28c9-efce-40d1-8f66-c8d0d6643503</entry>
Nov 08 20:50:15 user nova-compute[74638]:       <entry name="uuid">909c28c9-efce-40d1-8f66-c8d0d6643503</entry>
Nov 08 20:50:15 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:50:15 user nova-compute[74638]:     </system>
Nov 08 20:50:15 user nova-compute[74638]:   </sysinfo>
Nov 08 20:50:15 user nova-compute[74638]:   <os>
Nov 08 20:50:15 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:50:15 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:50:15 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:50:15 user nova-compute[74638]:   </os>
Nov 08 20:50:15 user nova-compute[74638]:   <features>
Nov 08 20:50:15 user nova-compute[74638]:     <acpi/>
Nov 08 20:50:15 user nova-compute[74638]:     <apic/>
Nov 08 20:50:15 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:50:15 user nova-compute[74638]:   </features>
Nov 08 20:50:15 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:50:15 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:50:15 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:50:15 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:50:15 user nova-compute[74638]:   </clock>
Nov 08 20:50:15 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:50:15 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:50:15 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:50:15 user nova-compute[74638]:   </cpu>
Nov 08 20:50:15 user nova-compute[74638]:   <devices>
Nov 08 20:50:15 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:50:15 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:50:15 user nova-compute[74638]:       <source dev="/dev/sdc"/>
Nov 08 20:50:15 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:50:15 user nova-compute[74638]:       <serial>57870941-f960-4516-ab58-50cd43b362e3</serial>
Nov 08 20:50:15 user nova-compute[74638]:     </disk>
Nov 08 20:50:15 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:50:15 user nova-compute[74638]:       <mac address="fa:16:3e:ba:db:e1"/>
Nov 08 20:50:15 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:50:15 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:50:15 user nova-compute[74638]:       <target dev="tap3b519614-fb"/>
Nov 08 20:50:15 user nova-compute[74638]:     </interface>
Nov 08 20:50:15 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:50:15 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/909c28c9-efce-40d1-8f66-c8d0d6643503/console.log" append="off"/>
Nov 08 20:50:15 user nova-compute[74638]:     </serial>
Nov 08 20:50:15 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:50:15 user nova-compute[74638]:     <video>
Nov 08 20:50:15 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:50:15 user nova-compute[74638]:     </video>
Nov 08 20:50:15 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:50:15 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:50:15 user nova-compute[74638]:     </rng>
Nov 08 20:50:15 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:50:15 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:50:15 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:50:15 user nova-compute[74638]:     </memballoon>
Nov 08 20:50:15 user nova-compute[74638]:   </devices>
Nov 08 20:50:15 user nova-compute[74638]: </domain>
Nov 08 20:50:15 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422126050',display_name='tempest-TestVolumeBootPattern-server-422126050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422126050',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-2vofyz13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T20:49:51Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=909c28c9-efce-40d1-8f66-c8d0d6643503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b519614-fbc6-46be-805d-a694e0e155a0,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b519614-fb') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG os_vif [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b519614-fbc6-46be-805d-a694e0e155a0,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b519614-fb') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd3bc828-0eee-51c0-b7e8-f60c095de6cf', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b519614-fb, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b519614-fb, col_values=(('qos', UUID('d4aa4576-c5b8-4fcf-961f-644488cc95eb')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b519614-fb, col_values=(('external_ids', {'iface-id': '3b519614-fbc6-46be-805d-a694e0e155a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:db:e1', 'vm-uuid': '909c28c9-efce-40d1-8f66-c8d0d6643503'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:15 user nova-compute[74638]: INFO os_vif [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b519614-fbc6-46be-805d-a694e0e155a0,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b519614-fb')
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:50:15 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] No VIF found with MAC fa:16:3e:ba:db:e1, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:50:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-e62cdca4-9e0f-4c08-b326-e512dbaaf1d2 req-cc47e6f9-9c82-4add-9f9c-14a6c383055b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e62cdca4-9e0f-4c08-b326-e512dbaaf1d2 req-cc47e6f9-9c82-4add-9f9c-14a6c383055b service nova] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e62cdca4-9e0f-4c08-b326-e512dbaaf1d2 req-cc47e6f9-9c82-4add-9f9c-14a6c383055b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:16 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e62cdca4-9e0f-4c08-b326-e512dbaaf1d2 req-cc47e6f9-9c82-4add-9f9c-14a6c383055b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:16 user nova-compute[74638]: DEBUG nova.compute.manager [req-e62cdca4-9e0f-4c08-b326-e512dbaaf1d2 req-cc47e6f9-9c82-4add-9f9c-14a6c383055b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] No waiting events found dispatching network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:50:16 user nova-compute[74638]: WARNING nova.compute.manager [req-e62cdca4-9e0f-4c08-b326-e512dbaaf1d2 req-cc47e6f9-9c82-4add-9f9c-14a6c383055b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received unexpected event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 for instance with vm_state building and task_state spawning.
Nov 08 20:50:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:50:18 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Instance spawned successfully.
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Found default for hw_cdrom_bus of ide {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Found default for hw_disk_bus of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Found default for hw_input_bus of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Found default for hw_pointer_model of None {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Found default for hw_video_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Found default for hw_vif_model of virtio {{(pid=74638) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 20:50:18 user nova-compute[74638]: INFO nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-60a06550-64fd-4adf-ab59-78c4f1e7b4ef req-ee589344-65ff-421e-accb-1cba6166f08f service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-60a06550-64fd-4adf-ab59-78c4f1e7b4ef req-ee589344-65ff-421e-accb-1cba6166f08f service nova] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-60a06550-64fd-4adf-ab59-78c4f1e7b4ef req-ee589344-65ff-421e-accb-1cba6166f08f service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-60a06550-64fd-4adf-ab59-78c4f1e7b4ef req-ee589344-65ff-421e-accb-1cba6166f08f service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-60a06550-64fd-4adf-ab59-78c4f1e7b4ef req-ee589344-65ff-421e-accb-1cba6166f08f service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] No waiting events found dispatching network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:50:18 user nova-compute[74638]: WARNING nova.compute.manager [req-60a06550-64fd-4adf-ab59-78c4f1e7b4ef req-ee589344-65ff-421e-accb-1cba6166f08f service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received unexpected event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 for instance with vm_state building and task_state spawning.
Nov 08 20:50:18 user nova-compute[74638]: INFO nova.compute.manager [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Took 28.16 seconds to build instance.
Nov 08 20:50:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73add3c6-0f63-46c7-a6ef-fc95d1cc526c tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.259s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:19 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:27 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:29 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:50:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:33 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:33 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:33 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:33 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:50:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:50:33 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:50:33 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:50:34 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:50:34 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.12845230102539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c0f1bb8d-6ad1-4586-bda0-9d6838319e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 909c28c9-efce-40d1-8f66-c8d0d6643503 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:50:34 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid c0f1bb8d-6ad1-4586-bda0-9d6838319e55 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating instance_info_cache with network_info: [{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:50:36 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:37 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:38 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:44 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:50:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:50:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:50:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:51:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:51:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:27 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:51:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:30 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:51:31 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:34 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:35 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:51:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:51:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:51:36 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:51:36 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:51:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.12704086303711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c0f1bb8d-6ad1-4586-bda0-9d6838319e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance 909c28c9-efce-40d1-8f66-c8d0d6643503 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:51:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updating instance_info_cache with network_info: [{"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:51:38 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:39 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:39 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:51:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-e5c0a9bb-c841-4332-bba6-c08bcd85f20e req-65ef75f8-4c07-45ef-bc35-c2364e626c5f service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-changed-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:42 user nova-compute[74638]: DEBUG nova.compute.manager [req-e5c0a9bb-c841-4332-bba6-c08bcd85f20e req-65ef75f8-4c07-45ef-bc35-c2364e626c5f service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Refreshing instance network info cache due to event network-changed-3b519614-fbc6-46be-805d-a694e0e155a0. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:51:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5c0a9bb-c841-4332-bba6-c08bcd85f20e req-65ef75f8-4c07-45ef-bc35-c2364e626c5f service nova] Acquiring lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:51:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5c0a9bb-c841-4332-bba6-c08bcd85f20e req-65ef75f8-4c07-45ef-bc35-c2364e626c5f service nova] Acquired lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:51:42 user nova-compute[74638]: DEBUG nova.network.neutron [req-e5c0a9bb-c841-4332-bba6-c08bcd85f20e req-65ef75f8-4c07-45ef-bc35-c2364e626c5f service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Refreshing network info cache for port 3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:51:42 user nova-compute[74638]: DEBUG nova.network.neutron [req-e5c0a9bb-c841-4332-bba6-c08bcd85f20e req-65ef75f8-4c07-45ef-bc35-c2364e626c5f service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updated VIF entry in instance network info cache for port 3b519614-fbc6-46be-805d-a694e0e155a0. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:51:42 user nova-compute[74638]: DEBUG nova.network.neutron [req-e5c0a9bb-c841-4332-bba6-c08bcd85f20e req-65ef75f8-4c07-45ef-bc35-c2364e626c5f service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updating instance_info_cache with network_info: [{"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:51:43 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-e5c0a9bb-c841-4332-bba6-c08bcd85f20e req-65ef75f8-4c07-45ef-bc35-c2364e626c5f service nova] Releasing lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8624658-b5f9-4161-bdfc-5f4ae15a87d2 req-de9dc01c-228d-4fdc-b21d-56e0d18f8402 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-changed-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG nova.compute.manager [req-f8624658-b5f9-4161-bdfc-5f4ae15a87d2 req-de9dc01c-228d-4fdc-b21d-56e0d18f8402 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Refreshing instance network info cache due to event network-changed-3b519614-fbc6-46be-805d-a694e0e155a0. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8624658-b5f9-4161-bdfc-5f4ae15a87d2 req-de9dc01c-228d-4fdc-b21d-56e0d18f8402 service nova] Acquiring lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8624658-b5f9-4161-bdfc-5f4ae15a87d2 req-de9dc01c-228d-4fdc-b21d-56e0d18f8402 service nova] Acquired lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG nova.network.neutron [req-f8624658-b5f9-4161-bdfc-5f4ae15a87d2 req-de9dc01c-228d-4fdc-b21d-56e0d18f8402 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Refreshing network info cache for port 3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:44 user nova-compute[74638]: INFO nova.compute.manager [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Terminating instance
Nov 08 20:51:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG nova.network.neutron [req-f8624658-b5f9-4161-bdfc-5f4ae15a87d2 req-de9dc01c-228d-4fdc-b21d-56e0d18f8402 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updated VIF entry in instance network info cache for port 3b519614-fbc6-46be-805d-a694e0e155a0. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG nova.network.neutron [req-f8624658-b5f9-4161-bdfc-5f4ae15a87d2 req-de9dc01c-228d-4fdc-b21d-56e0d18f8402 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updating instance_info_cache with network_info: [{"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:51:44 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-f8624658-b5f9-4161-bdfc-5f4ae15a87d2 req-de9dc01c-228d-4fdc-b21d-56e0d18f8402 service nova] Releasing lock "refresh_cache-909c28c9-efce-40d1-8f66-c8d0d6643503" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Instance destroyed successfully.
Nov 08 20:51:45 user nova-compute[74638]: DEBUG nova.objects.instance [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'resources' on Instance uuid 909c28c9-efce-40d1-8f66-c8d0d6643503 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422126050',display_name='tempest-TestVolumeBootPattern-server-422126050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422126050',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-2vofyz13',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:50:19Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=909c28c9-efce-40d1-8f66-c8d0d6643503,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "3b519614-fbc6-46be-805d-a694e0e155a0", "address": "fa:16:3e:ba:db:e1", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b519614-fb", "ovs_interfaceid": "3b519614-fbc6-46be-805d-a694e0e155a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b519614-fbc6-46be-805d-a694e0e155a0,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b519614-fb') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_vif [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b519614-fbc6-46be-805d-a694e0e155a0,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b519614-fb') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b519614-fb, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4aa4576-c5b8-4fcf-961f-644488cc95eb) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: INFO os_vif [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b519614-fbc6-46be-805d-a694e0e155a0,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b519614-fb')
Nov 08 20:51:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaMzNuFR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:51:45 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7139feac-6b07-480e-a3ba-056d2d47a573]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:51:45 user nova-compute[74638]: No targets found.
Nov 08 20:51:45 user nova-compute[74638]: iSNS:
Nov 08 20:51:45 user nova-compute[74638]: No targets found.
Nov 08 20:51:45 user nova-compute[74638]: STATIC:
Nov 08 20:51:45 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56
Nov 08 20:51:45 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:51:45 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:51:45 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3
Nov 08 20:51:45 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:51:45 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:51:45 user nova-compute[74638]: FIRMWARE:
Nov 08 20:51:45 user nova-compute[74638]: No targets found.
Nov 08 20:51:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:51:45 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:51:45 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6127d1-203b-432b-8367-5744bc9a28b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf15a59e-d14e-458b-b24a-61b3f6cfe371]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:51:45 user nova-compute[74638]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 (non-flash)
Nov 08 20:51:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:51:45 user nova-compute[74638]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 (non-flash)
Nov 08 20:51:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c5cbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9d61d9-05e8-48e7-9e2a-b85eb5579fc4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dd8c05-12cd-4909-8acd-7e9a71075e56]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[354da63e-f46a-47d3-9e60-95b5dd050659]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ea991e-7824-4749-8b89-3079a4b583b5]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba57154c-d354-4575-9ea8-96f3d4d72959]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97502af-3522-4ed2-9af2-6e7ecbe7fb33]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3, portal: 172.16.0.220,3260]
Nov 08 20:51:45 user nova-compute[74638]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3, portal: 172.16.0.220,3260] successful.
Nov 08 20:51:45 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57870941-f960-4516-ab58-50cd43b362e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed4ca1-8029-4ba5-82d5-0111dc3dcfd7]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== disconnect_volume: return (342ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:51:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Deleting instance files /opt/stack/data/nova/instances/909c28c9-efce-40d1-8f66-c8d0d6643503_del
Nov 08 20:51:45 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Deletion of /opt/stack/data/nova/instances/909c28c9-efce-40d1-8f66-c8d0d6643503_del complete
Nov 08 20:51:45 user nova-compute[74638]: INFO nova.compute.manager [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 20:51:45 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-unplugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] No waiting events found dispatching network-vif-unplugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-unplugged-3b519614-fbc6-46be-805d-a694e0e155a0 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] No waiting events found dispatching network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:51:46 user nova-compute[74638]: WARNING nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received unexpected event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 for instance with vm_state active and task_state deleting.
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] No waiting events found dispatching network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:51:46 user nova-compute[74638]: WARNING nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received unexpected event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 for instance with vm_state active and task_state deleting.
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] No waiting events found dispatching network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:51:46 user nova-compute[74638]: WARNING nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received unexpected event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 for instance with vm_state active and task_state deleting.
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-unplugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] No waiting events found dispatching network-vif-unplugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-unplugged-3b519614-fbc6-46be-805d-a694e0e155a0 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Acquiring lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] No waiting events found dispatching network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:51:46 user nova-compute[74638]: WARNING nova.compute.manager [req-dfdebc9b-13b7-4fc0-b8bd-6b441ad47a3b req-2b7eb067-8451-4444-964b-2d5ba970846b service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received unexpected event network-vif-plugged-3b519614-fbc6-46be-805d-a694e0e155a0 for instance with vm_state active and task_state deleting.
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-443dace7-6501-4f05-9208-782685df226f req-3aa9162b-9159-4ef0-af44-64a37c4b1911 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Received event network-vif-deleted-3b519614-fbc6-46be-805d-a694e0e155a0 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:51:46 user nova-compute[74638]: INFO nova.compute.manager [req-443dace7-6501-4f05-9208-782685df226f req-3aa9162b-9159-4ef0-af44-64a37c4b1911 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Neutron deleted interface 3b519614-fbc6-46be-805d-a694e0e155a0; detaching it from the instance and deleting it from the info cache
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.network.neutron [req-443dace7-6501-4f05-9208-782685df226f req-3aa9162b-9159-4ef0-af44-64a37c4b1911 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:51:46 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Took 0.77 seconds to deallocate network for instance.
Nov 08 20:51:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-443dace7-6501-4f05-9208-782685df226f req-3aa9162b-9159-4ef0-af44-64a37c4b1911 service nova] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Detach interface failed, port_id=3b519614-fbc6-46be-805d-a694e0e155a0, reason: Instance 909c28c9-efce-40d1-8f66-c8d0d6643503 could not be found. {{(pid=74638) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 20:51:47 user nova-compute[74638]: INFO nova.compute.manager [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: 909c28c9-efce-40d1-8f66-c8d0d6643503] Took 0.93 seconds to detach 1 volumes for instance.
Nov 08 20:51:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:47 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:51:47 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:51:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:47 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Deleted allocations for instance 909c28c9-efce-40d1-8f66-c8d0d6643503
Nov 08 20:51:47 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-7fbaa9b4-50bf-4c8c-92cf-999aaac1d9e1 tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "909c28c9-efce-40d1-8f66-c8d0d6643503" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.372s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:51:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:51:55 user nova-compute[74638]: INFO nova.compute.manager [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Unshelving
Nov 08 20:51:55 user nova-compute[74638]: INFO nova.virt.block_device [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Booting with volume 21210e08-68ab-4ec3-aabc-7c8a72300feb at /dev/vda
Nov 08 20:51:55 user nova-compute[74638]: DEBUG os_brick.utils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f93560c-2bc8-4c8b-81bb-3c182fd7e4ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5881f22f211d\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc5772a-46c7-4c63-a772-9ec5cf3a2ff2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0123698f-b4bc-4484-87f6-777b7d1f87cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6fcaf0-bd74-48c2-b43b-ef33d99442d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Running cmd (subprocess): nvme version {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] 'nvme version' failed. Not Retrying. {{(pid=74638) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] nvme not present on system {{(pid=74638) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 20:51:55 user nova-compute[74638]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 20:51:55 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f5332d-668f-4e96-9180-0e1c852ef5a0]: (4, '') {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74638) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.lightos [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] LIGHTOS: no hostnqn found. {{(pid=74638) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG os_brick.utils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5881f22f211d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:51:55 user nova-compute[74638]: DEBUG nova.virt.block_device [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating existing volume attachment record: 56231e74-e77f-4970-ab04-291f905cbf04 {{(pid=74638) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 20:52:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:52:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:52:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:52:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:52:17 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lazy-loading 'pci_requests' on Instance uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:52:17 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lazy-loading 'numa_topology' on Instance uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:52:17 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74638) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 20:52:17 user nova-compute[74638]: INFO nova.compute.claims [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Claim successful on node user
Nov 08 20:52:17 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:52:17 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:52:17 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:52:17 user nova-compute[74638]: INFO nova.network.neutron [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating port 42676bb9-c900-4125-9f52-5417288ef2c7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Building network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-22bbd89c-5fb1-42e9-9b97-1ecbc485cae3 req-e4088383-0739-432c-9275-974b0c9f938a service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.compute.manager [req-22bbd89c-5fb1-42e9-9b97-1ecbc485cae3 req-e4088383-0739-432c-9275-974b0c9f938a service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing instance network info cache due to event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22bbd89c-5fb1-42e9-9b97-1ecbc485cae3 req-e4088383-0739-432c-9275-974b0c9f938a service nova] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.network.neutron [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Creating instance directory {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 20:52:18 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Creating image(s)
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Did not create local disks {{(pid=74638) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Ensure instance console log exists: /opt/stack/data/nova/instances/cecc1165-825d-46d6-be55-81b70cef33c5/console.log {{(pid=74638) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Start _get_guest_xml network_info=[{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'attachment_id': '56231e74-e77f-4970-ab04-291f905cbf04', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDIkymjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cecc1165-825d-46d6-be55-81b70cef33c5', 'attached_at': '', 'detached_at': '', 'volume_id': '21210e08-68ab-4ec3-aabc-7c8a72300feb', 'serial': '21210e08-68ab-4ec3-aabc-7c8a72300feb'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22bbd89c-5fb1-42e9-9b97-1ecbc485cae3 req-e4088383-0739-432c-9275-974b0c9f938a service nova] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.network.neutron [req-22bbd89c-5fb1-42e9-9b97-1ecbc485cae3 req-e4088383-0739-432c-9275-974b0c9f938a service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:52:18 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:52:18 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] CPU controller missing on host. {{(pid=74638) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.host [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] CPU controller found on host. {{(pid=74638) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74638) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T20:02:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Flavor limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Image limits 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Flavor pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Image pref 0:0:0 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Got 1 possible topologies {{(pid=74638) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.hardware [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74638) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lazy-loading 'vcpu_model' on Instance uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.objects.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Object Instance<cecc1165-825d-46d6-be55-81b70cef33c5> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Calling os-brick to attach iSCSI Volume {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDIkymjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:52:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:52:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:52:18 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:52:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:52:18 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:52:18 user nova-compute[74638]: INFO os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 20:52:18 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[44479dd3-93cd-486b-9fe8-9aed69968c20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 20:52:19 user nova-compute[74638]:  {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --interface default --op new {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2591747-0909-47d5-95a6-9c475e1158ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb] added\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb] added
Nov 08 20:52:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[006291e9-0376-46b6-8e34-7815c86557cd]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0811a4ed-b20d-416d-bc5b-6dd49f3cf741]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDIkymjl {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDIkymjl" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[96002352-d1bb-480d-a358-3c2040f34572]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YDIkymjl'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7af6fb-779e-47da-9f1f-0f3ad93eb31a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52730d7-2f81-4e4a-b7a0-c98d37ecb614]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:52:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:52:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --login {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[54892cec-1c80-4463-9954-974d347e11b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260]
Nov 08 20:52:19 user nova-compute[74638]: Login to [iface: default, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260] successful.
Nov 08 20:52:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20bce16-4dae-41c9-b376-41a5367b0591]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e89f5ef-d92b-4bdc-918a-53657cceb92c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:52:19 user nova-compute[74638]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:52:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:52:19 user nova-compute[74638]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:52:19 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Connected to 172.16.0.220:3260 {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74638) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74638) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG nova.network.neutron [req-22bbd89c-5fb1-42e9-9b97-1ecbc485cae3 req-e4088383-0739-432c-9275-974b0c9f938a service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updated VIF entry in instance network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG nova.network.neutron [req-22bbd89c-5fb1-42e9-9b97-1ecbc485cae3 req-e4088383-0739-432c-9275-974b0c9f938a service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e77fc0-c902-46c1-948a-abbb600d8ebd]: (4, ('- - 0', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74638) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDIkymjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74638) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 20:52:19 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-22bbd89c-5fb1-42e9-9b97-1ecbc485cae3 req-e4088383-0739-432c-9275-974b0c9f938a service nova] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23138623437623133', 'path': '/dev/sdc'} {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138623437623133', 'path': '/dev/sdc'} {{(pid=74638) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-347611892',display_name='tempest-TestShelveInstance-server-347611892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-347611892',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1320692797',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cc383d8a631f461fbe2920483635c17a',ramdisk_id='',reservation_id='r-nem41kkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-331524812',owner_user_name='tempest-TestShelveInstance-331524812-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:51:55Z,user_data=None,user_id='a47f61da50b04951ac8b351b343b8881',uuid=cecc1165-825d-46d6-be55-81b70cef33c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74638) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converting VIF {"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.objects.instance [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lazy-loading 'pci_devices' on Instance uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.objects.base [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Object Instance<cecc1165-825d-46d6-be55-81b70cef33c5> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74638) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 20:52:20 user nova-compute[74638]:   <uuid>cecc1165-825d-46d6-be55-81b70cef33c5</uuid>
Nov 08 20:52:20 user nova-compute[74638]:   <name>instance-00000033</name>
Nov 08 20:52:20 user nova-compute[74638]:   <memory>524288</memory>
Nov 08 20:52:20 user nova-compute[74638]:   <vcpu>1</vcpu>
Nov 08 20:52:20 user nova-compute[74638]:   <metadata>
Nov 08 20:52:20 user nova-compute[74638]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 20:52:20 user nova-compute[74638]:       <nova:package version="0.0.0"/>
Nov 08 20:52:20 user nova-compute[74638]:       <nova:name>tempest-TestShelveInstance-server-347611892</nova:name>
Nov 08 20:52:20 user nova-compute[74638]:       <nova:creationTime>2023-11-08 20:52:18</nova:creationTime>
Nov 08 20:52:20 user nova-compute[74638]:       <nova:flavor name="m1.tiny">
Nov 08 20:52:20 user nova-compute[74638]:         <nova:memory>512</nova:memory>
Nov 08 20:52:20 user nova-compute[74638]:         <nova:disk>1</nova:disk>
Nov 08 20:52:20 user nova-compute[74638]:         <nova:swap>0</nova:swap>
Nov 08 20:52:20 user nova-compute[74638]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 20:52:20 user nova-compute[74638]:         <nova:vcpus>1</nova:vcpus>
Nov 08 20:52:20 user nova-compute[74638]:       </nova:flavor>
Nov 08 20:52:20 user nova-compute[74638]:       <nova:owner>
Nov 08 20:52:20 user nova-compute[74638]:         <nova:user uuid="a47f61da50b04951ac8b351b343b8881">tempest-TestShelveInstance-331524812-project-member</nova:user>
Nov 08 20:52:20 user nova-compute[74638]:         <nova:project uuid="cc383d8a631f461fbe2920483635c17a">tempest-TestShelveInstance-331524812</nova:project>
Nov 08 20:52:20 user nova-compute[74638]:       </nova:owner>
Nov 08 20:52:20 user nova-compute[74638]:       <nova:ports>
Nov 08 20:52:20 user nova-compute[74638]:         <nova:port uuid="42676bb9-c900-4125-9f52-5417288ef2c7">
Nov 08 20:52:20 user nova-compute[74638]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 20:52:20 user nova-compute[74638]:         </nova:port>
Nov 08 20:52:20 user nova-compute[74638]:       </nova:ports>
Nov 08 20:52:20 user nova-compute[74638]:     </nova:instance>
Nov 08 20:52:20 user nova-compute[74638]:   </metadata>
Nov 08 20:52:20 user nova-compute[74638]:   <sysinfo type="smbios">
Nov 08 20:52:20 user nova-compute[74638]:     <system>
Nov 08 20:52:20 user nova-compute[74638]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 20:52:20 user nova-compute[74638]:       <entry name="product">OpenStack Nova</entry>
Nov 08 20:52:20 user nova-compute[74638]:       <entry name="version">0.0.0</entry>
Nov 08 20:52:20 user nova-compute[74638]:       <entry name="serial">cecc1165-825d-46d6-be55-81b70cef33c5</entry>
Nov 08 20:52:20 user nova-compute[74638]:       <entry name="uuid">cecc1165-825d-46d6-be55-81b70cef33c5</entry>
Nov 08 20:52:20 user nova-compute[74638]:       <entry name="family">Virtual Machine</entry>
Nov 08 20:52:20 user nova-compute[74638]:     </system>
Nov 08 20:52:20 user nova-compute[74638]:   </sysinfo>
Nov 08 20:52:20 user nova-compute[74638]:   <os>
Nov 08 20:52:20 user nova-compute[74638]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 20:52:20 user nova-compute[74638]:     <boot dev="hd"/>
Nov 08 20:52:20 user nova-compute[74638]:     <smbios mode="sysinfo"/>
Nov 08 20:52:20 user nova-compute[74638]:   </os>
Nov 08 20:52:20 user nova-compute[74638]:   <features>
Nov 08 20:52:20 user nova-compute[74638]:     <acpi/>
Nov 08 20:52:20 user nova-compute[74638]:     <apic/>
Nov 08 20:52:20 user nova-compute[74638]:     <vmcoreinfo/>
Nov 08 20:52:20 user nova-compute[74638]:   </features>
Nov 08 20:52:20 user nova-compute[74638]:   <clock offset="utc">
Nov 08 20:52:20 user nova-compute[74638]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 20:52:20 user nova-compute[74638]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 20:52:20 user nova-compute[74638]:     <timer name="hpet" present="no"/>
Nov 08 20:52:20 user nova-compute[74638]:   </clock>
Nov 08 20:52:20 user nova-compute[74638]:   <cpu mode="custom" match="exact">
Nov 08 20:52:20 user nova-compute[74638]:     <model>Nehalem</model>
Nov 08 20:52:20 user nova-compute[74638]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 20:52:20 user nova-compute[74638]:   </cpu>
Nov 08 20:52:20 user nova-compute[74638]:   <devices>
Nov 08 20:52:20 user nova-compute[74638]:     <disk type="block" device="disk">
Nov 08 20:52:20 user nova-compute[74638]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 20:52:20 user nova-compute[74638]:       <source dev="/dev/sdc"/>
Nov 08 20:52:20 user nova-compute[74638]:       <target dev="vda" bus="virtio"/>
Nov 08 20:52:20 user nova-compute[74638]:       <serial>21210e08-68ab-4ec3-aabc-7c8a72300feb</serial>
Nov 08 20:52:20 user nova-compute[74638]:     </disk>
Nov 08 20:52:20 user nova-compute[74638]:     <interface type="ethernet">
Nov 08 20:52:20 user nova-compute[74638]:       <mac address="fa:16:3e:9e:4d:eb"/>
Nov 08 20:52:20 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:52:20 user nova-compute[74638]:       <mtu size="1442"/>
Nov 08 20:52:20 user nova-compute[74638]:       <target dev="tap42676bb9-c9"/>
Nov 08 20:52:20 user nova-compute[74638]:     </interface>
Nov 08 20:52:20 user nova-compute[74638]:     <serial type="pty">
Nov 08 20:52:20 user nova-compute[74638]:       <log file="/opt/stack/data/nova/instances/cecc1165-825d-46d6-be55-81b70cef33c5/console.log" append="off"/>
Nov 08 20:52:20 user nova-compute[74638]:     </serial>
Nov 08 20:52:20 user nova-compute[74638]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 20:52:20 user nova-compute[74638]:     <video>
Nov 08 20:52:20 user nova-compute[74638]:       <model type="virtio"/>
Nov 08 20:52:20 user nova-compute[74638]:     </video>
Nov 08 20:52:20 user nova-compute[74638]:     <rng model="virtio">
Nov 08 20:52:20 user nova-compute[74638]:       <backend model="random">/dev/urandom</backend>
Nov 08 20:52:20 user nova-compute[74638]:     </rng>
Nov 08 20:52:20 user nova-compute[74638]:     <controller type="usb" index="0" model="none"/>
Nov 08 20:52:20 user nova-compute[74638]:     <memballoon model="virtio">
Nov 08 20:52:20 user nova-compute[74638]:       <stats period="10"/>
Nov 08 20:52:20 user nova-compute[74638]:     </memballoon>
Nov 08 20:52:20 user nova-compute[74638]:   </devices>
Nov 08 20:52:20 user nova-compute[74638]: </domain>
Nov 08 20:52:20 user nova-compute[74638]:  {{(pid=74638) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-347611892',display_name='tempest-TestShelveInstance-server-347611892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-347611892',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1320692797',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cc383d8a631f461fbe2920483635c17a',ramdisk_id='',reservation_id='r-nem41kkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-331524812',owner_user_name='tempest-TestShelveInstance-331524812-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:51:55Z,user_data=None,user_id='a47f61da50b04951ac8b351b343b8881',uuid=cecc1165-825d-46d6-be55-81b70cef33c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converting VIF {"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG os_vif [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e7b1053-b1f5-5c90-b81d-10c17deca749', '_type': 'linux-noop'}}, row=False) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42676bb9-c9, may_exist=True, interface_attrs={}) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42676bb9-c9, col_values=(('qos', UUID('5a9164cc-fb98-43fe-bdc8-8a102c929650')),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42676bb9-c9, col_values=(('external_ids', {'iface-id': '42676bb9-c900-4125-9f52-5417288ef2c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:4d:eb', 'vm-uuid': 'cecc1165-825d-46d6-be55-81b70cef33c5'}),), if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:20 user nova-compute[74638]: INFO os_vif [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9')
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] No BDM found with device name vda, not building metadata. {{(pid=74638) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 20:52:20 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] No VIF found with MAC fa:16:3e:9e:4d:eb, not building metadata {{(pid=74638) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 20:52:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-74b9e14b-3b98-42df-b81b-752afd6bfb97 req-db531ebe-e1cf-4e4a-8c28-56679e03addf service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:52:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-74b9e14b-3b98-42df-b81b-752afd6bfb97 req-db531ebe-e1cf-4e4a-8c28-56679e03addf service nova] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:52:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-74b9e14b-3b98-42df-b81b-752afd6bfb97 req-db531ebe-e1cf-4e4a-8c28-56679e03addf service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:52:21 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-74b9e14b-3b98-42df-b81b-752afd6bfb97 req-db531ebe-e1cf-4e4a-8c28-56679e03addf service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:52:21 user nova-compute[74638]: DEBUG nova.compute.manager [req-74b9e14b-3b98-42df-b81b-752afd6bfb97 req-db531ebe-e1cf-4e4a-8c28-56679e03addf service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] No waiting events found dispatching network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:52:21 user nova-compute[74638]: WARNING nova.compute.manager [req-74b9e14b-3b98-42df-b81b-752afd6bfb97 req-db531ebe-e1cf-4e4a-8c28-56679e03addf service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received unexpected event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 20:52:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:22 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance event wait completed in 0 seconds for  {{(pid=74638) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 20:52:23 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Guest created on hypervisor {{(pid=74638) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 20:52:23 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance spawned successfully.
Nov 08 20:52:23 user nova-compute[74638]: DEBUG nova.compute.manager [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Checking state {{(pid=74638) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 20:52:23 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-a092c4fd-da22-4c4b-a798-69e8748edfe1 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.602s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:52:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-1c5d839c-cb21-45d6-a9c7-4e859f4eea0b req-520a217a-2bc8-45f6-8db2-3aea293bd207 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:52:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1c5d839c-cb21-45d6-a9c7-4e859f4eea0b req-520a217a-2bc8-45f6-8db2-3aea293bd207 service nova] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:52:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1c5d839c-cb21-45d6-a9c7-4e859f4eea0b req-520a217a-2bc8-45f6-8db2-3aea293bd207 service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:52:24 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-1c5d839c-cb21-45d6-a9c7-4e859f4eea0b req-520a217a-2bc8-45f6-8db2-3aea293bd207 service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:52:24 user nova-compute[74638]: DEBUG nova.compute.manager [req-1c5d839c-cb21-45d6-a9c7-4e859f4eea0b req-520a217a-2bc8-45f6-8db2-3aea293bd207 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] No waiting events found dispatching network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:52:24 user nova-compute[74638]: WARNING nova.compute.manager [req-1c5d839c-cb21-45d6-a9c7-4e859f4eea0b req-520a217a-2bc8-45f6-8db2-3aea293bd207 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received unexpected event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 for instance with vm_state active and task_state None.
Nov 08 20:52:24 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:32 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:32 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:52:33 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:52:35 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:52:36 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:52:36 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.11685562133789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance c0f1bb8d-6ad1-4586-bda0-9d6838319e55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance cecc1165-825d-46d6-be55-81b70cef33c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing inventories for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating ProviderTree inventory for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Updating inventory in ProviderTree for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing aggregate associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, aggregates: None {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Refreshing trait associations for resource provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8, traits: COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE {{(pid=74638) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:36 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74638) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 20:52:38 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:39 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:52:39 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:52:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:52:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:52:39 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:52:39 user nova-compute[74638]: DEBUG nova.objects.instance [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lazy-loading 'info_cache' on Instance uuid c0f1bb8d-6ad1-4586-bda0-9d6838319e55 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:52:39 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating instance_info_cache with network_info: [{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:52:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:52:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:52:40 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:40 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:41 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:44 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:49 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:52:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Cleaning up deleted instances {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 20:52:49 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] There are 0 instances to clean {{(pid=74638) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 20:52:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:50 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:54 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:52:55 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:00 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:53:05 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-0b5ffde1-b53b-44eb-b78c-aef6aae8aa40 req-d570ba51-4443-457c-9d3f-a40c2d0d6973 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-changed-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-0b5ffde1-b53b-44eb-b78c-aef6aae8aa40 req-d570ba51-4443-457c-9d3f-a40c2d0d6973 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Refreshing instance network info cache due to event network-changed-df50b40c-dacf-455f-baf0-d8a9ebc22fdc. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0b5ffde1-b53b-44eb-b78c-aef6aae8aa40 req-d570ba51-4443-457c-9d3f-a40c2d0d6973 service nova] Acquiring lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0b5ffde1-b53b-44eb-b78c-aef6aae8aa40 req-d570ba51-4443-457c-9d3f-a40c2d0d6973 service nova] Acquired lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-0b5ffde1-b53b-44eb-b78c-aef6aae8aa40 req-d570ba51-4443-457c-9d3f-a40c2d0d6973 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Refreshing network info cache for port df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:09 user nova-compute[74638]: INFO nova.compute.manager [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Terminating instance
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.compute.manager [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-33006df8-b8f1-4007-a726-49ae3fedf70a req-e3a50c4c-1e4c-41d1-bf55-ffc6317dd174 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-unplugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-33006df8-b8f1-4007-a726-49ae3fedf70a req-e3a50c4c-1e4c-41d1-bf55-ffc6317dd174 service nova] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-33006df8-b8f1-4007-a726-49ae3fedf70a req-e3a50c4c-1e4c-41d1-bf55-ffc6317dd174 service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-33006df8-b8f1-4007-a726-49ae3fedf70a req-e3a50c4c-1e4c-41d1-bf55-ffc6317dd174 service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-33006df8-b8f1-4007-a726-49ae3fedf70a req-e3a50c4c-1e4c-41d1-bf55-ffc6317dd174 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] No waiting events found dispatching network-vif-unplugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.compute.manager [req-33006df8-b8f1-4007-a726-49ae3fedf70a req-e3a50c4c-1e4c-41d1-bf55-ffc6317dd174 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-unplugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-0b5ffde1-b53b-44eb-b78c-aef6aae8aa40 req-d570ba51-4443-457c-9d3f-a40c2d0d6973 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updated VIF entry in instance network info cache for port df50b40c-dacf-455f-baf0-d8a9ebc22fdc. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG nova.network.neutron [req-0b5ffde1-b53b-44eb-b78c-aef6aae8aa40 req-d570ba51-4443-457c-9d3f-a40c2d0d6973 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating instance_info_cache with network_info: [{"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:53:09 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-0b5ffde1-b53b-44eb-b78c-aef6aae8aa40 req-d570ba51-4443-457c-9d3f-a40c2d0d6973 service nova] Releasing lock "refresh_cache-c0f1bb8d-6ad1-4586-bda0-9d6838319e55" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Instance destroyed successfully.
Nov 08 20:53:10 user nova-compute[74638]: DEBUG nova.objects.instance [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lazy-loading 'resources' on Instance uuid c0f1bb8d-6ad1-4586-bda0-9d6838319e55 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T20:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1842722633',display_name='tempest-TestVolumeBootPattern-server-1842722633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1842722633',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+lOv+PYUkRSuMSS2haFgCOvqdn0G+idkWnv3BUrYQT6MaO73/H6wAKmn1E0GJ4yjQ5GYI6gAD/Bnkda/sO59jd9ywP3+52PEYTYhTEj2NxHiKVvYaXZ/cRl2UgBEgNbg==',key_name='tempest-TestVolumeBootPattern-876732762',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:48:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e599a20be834415ea60230b8743a2338',ramdisk_id='',reservation_id='r-fjh13w1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1116596406',owner_user_name='tempest-TestVolumeBootPattern-1116596406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:48:09Z,user_data=None,user_id='f63d3b55213f44fbb4dd76758a9a61ed',uuid=c0f1bb8d-6ad1-4586-bda0-9d6838319e55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converting VIF {"id": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "address": "fa:16:3e:dd:ab:a2", "network": {"id": "1021a2a7-62ff-4fa6-b436-d90dbb6a7b81", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1112148231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e599a20be834415ea60230b8743a2338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf50b40c-da", "ovs_interfaceid": "df50b40c-dacf-455f-baf0-d8a9ebc22fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ab:a2,bridge_name='br-int',has_traffic_filtering=True,id=df50b40c-dacf-455f-baf0-d8a9ebc22fdc,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf50b40c-da') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_vif [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ab:a2,bridge_name='br-int',has_traffic_filtering=True,id=df50b40c-dacf-455f-baf0-d8a9ebc22fdc,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf50b40c-da') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf50b40c-da, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e5a1efa-bc57-4e9e-a33d-c997d47b05aa) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:53:10 user nova-compute[74638]: INFO os_vif [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ab:a2,bridge_name='br-int',has_traffic_filtering=True,id=df50b40c-dacf-455f-baf0-d8a9ebc22fdc,network=Network(1021a2a7-62ff-4fa6-b436-d90dbb6a7b81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf50b40c-da')
Nov 08 20:53:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaZhkXFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:53:10 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c99f5e-4f09-45de-97b8-221db7967592]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:53:10 user nova-compute[74638]: No targets found.
Nov 08 20:53:10 user nova-compute[74638]: iSNS:
Nov 08 20:53:10 user nova-compute[74638]: No targets found.
Nov 08 20:53:10 user nova-compute[74638]: STATIC:
Nov 08 20:53:10 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb
Nov 08 20:53:10 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:53:10 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:53:10 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56
Nov 08 20:53:10 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:53:10 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:53:10 user nova-compute[74638]: FIRMWARE:
Nov 08 20:53:10 user nova-compute[74638]: No targets found.
Nov 08 20:53:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:53:10 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:53:10 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4690822d-f368-46b9-a5d0-f2a1b50f2614]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669f1df-a5a5-405e-b1e1-94251d4dd132]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:53:10 user nova-compute[74638]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:53:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 (non-flash)
Nov 08 20:53:10 user nova-compute[74638]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:53:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c356050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56'): ({'sdb'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Removing single pathed devices sdb {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880c42f-d01c-4a62-bf40-e289cb6facd7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f001c2d-1be7-463d-b333-a1d81c2185e7]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Flushing IO for device /dev/sdb {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[710aa69b-3d85-4d53-8bf1-6c36378360df]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae461c36-4ab2-4dee-b179-5439ef578714]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] SCSI volumes sdb have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26533306663303936', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_24bec9a5', '/dev/disk/by-id/scsi-1SCST_BIO24bec9a5-e30fc096fee1a5bd') {{(pid=85977) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1c7d2d-9561-4126-9016-77a885dc2e46]: (4, None) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9405bf-2e23-46fb-9ff8-d5f26d4fdbee]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[88199252-8dd8-4668-9117-c25874eb5204]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260]
Nov 08 20:53:10 user nova-compute[74638]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56, portal: 172.16.0.220,3260] successful.
Nov 08 20:53:10 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b2e6e09-f194-4fb6-b6d2-d7a959ff8e56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fdb40f-6395-47c1-8acd-9e576d2b186a]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] <== disconnect_volume: return (364ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:53:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Deleting instance files /opt/stack/data/nova/instances/c0f1bb8d-6ad1-4586-bda0-9d6838319e55_del
Nov 08 20:53:10 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Deletion of /opt/stack/data/nova/instances/c0f1bb8d-6ad1-4586-bda0-9d6838319e55_del complete
Nov 08 20:53:10 user nova-compute[74638]: INFO nova.compute.manager [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 08 20:53:10 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:53:10 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:53:11 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Took 0.65 seconds to deallocate network for instance.
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-6dee43f1-1782-43cc-9ebf-b610b99435c0 req-8d69fee4-6219-4b27-96d8-fe03abe3d36c service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-deleted-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] No waiting events found dispatching network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:53:11 user nova-compute[74638]: WARNING nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received unexpected event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc for instance with vm_state active and task_state deleting.
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] No waiting events found dispatching network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:53:11 user nova-compute[74638]: WARNING nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received unexpected event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc for instance with vm_state active and task_state deleting.
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] No waiting events found dispatching network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:53:11 user nova-compute[74638]: WARNING nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received unexpected event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc for instance with vm_state active and task_state deleting.
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-unplugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] No waiting events found dispatching network-vif-unplugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:53:11 user nova-compute[74638]: DEBUG nova.compute.manager [req-966ceb5e-fae0-4dd9-8be3-5c95e24c5063 req-78bed29b-7242-4f18-8beb-f631e07c570d service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-unplugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:53:12 user nova-compute[74638]: INFO nova.compute.manager [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Took 0.91 seconds to detach 1 volumes for instance.
Nov 08 20:53:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:12 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:53:12 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:53:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:12 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Deleted allocations for instance c0f1bb8d-6ad1-4586-bda0-9d6838319e55
Nov 08 20:53:12 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-e8ed2538-7737-4f6f-a2da-7118a0bf5eec tempest-TestVolumeBootPattern-1116596406 tempest-TestVolumeBootPattern-1116596406-project-member] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.110s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-ec5af4a0-cb88-4ee0-a576-a810d6317776 req-90e88d2e-5197-41a6-b9b4-90e318d5b1d1 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ec5af4a0-cb88-4ee0-a576-a810d6317776 req-90e88d2e-5197-41a6-b9b4-90e318d5b1d1 service nova] Acquiring lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ec5af4a0-cb88-4ee0-a576-a810d6317776 req-90e88d2e-5197-41a6-b9b4-90e318d5b1d1 service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:13 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-ec5af4a0-cb88-4ee0-a576-a810d6317776 req-90e88d2e-5197-41a6-b9b4-90e318d5b1d1 service nova] Lock "c0f1bb8d-6ad1-4586-bda0-9d6838319e55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:13 user nova-compute[74638]: DEBUG nova.compute.manager [req-ec5af4a0-cb88-4ee0-a576-a810d6317776 req-90e88d2e-5197-41a6-b9b4-90e318d5b1d1 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] No waiting events found dispatching network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:53:13 user nova-compute[74638]: WARNING nova.compute.manager [req-ec5af4a0-cb88-4ee0-a576-a810d6317776 req-90e88d2e-5197-41a6-b9b4-90e318d5b1d1 service nova] [instance: c0f1bb8d-6ad1-4586-bda0-9d6838319e55] Received unexpected event network-vif-plugged-df50b40c-dacf-455f-baf0-d8a9ebc22fdc for instance with vm_state deleted and task_state None.
Nov 08 20:53:15 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:20 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:53:25 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:29 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:29 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Triggering sync for uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 20:53:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:29 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:30 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:33 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:33 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:53:35 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:36 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:37 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:37 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:37 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:53:37 user nova-compute[74638]: DEBUG nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74638) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 20:53:38 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:53:38 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:53:38 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.115619659423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Instance cecc1165-825d-46d6-be55-81b70cef33c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74638) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:53:38 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Forcefully refreshing network info cache for instance {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG nova.network.neutron [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updated the network info_cache for instance {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 20:53:40 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:42 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:42 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-d7c2470f-b76e-4679-b188-a20895cbe2d9 req-12c351b8-1049-46fd-b679-f51673cdfda6 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG nova.compute.manager [req-d7c2470f-b76e-4679-b188-a20895cbe2d9 req-12c351b8-1049-46fd-b679-f51673cdfda6 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing instance network info cache due to event network-changed-42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7c2470f-b76e-4679-b188-a20895cbe2d9 req-12c351b8-1049-46fd-b679-f51673cdfda6 service nova] Acquiring lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7c2470f-b76e-4679-b188-a20895cbe2d9 req-12c351b8-1049-46fd-b679-f51673cdfda6 service nova] Acquired lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG nova.network.neutron [req-d7c2470f-b76e-4679-b188-a20895cbe2d9 req-12c351b8-1049-46fd-b679-f51673cdfda6 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Refreshing network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:45 user nova-compute[74638]: INFO nova.compute.manager [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Terminating instance
Nov 08 20:53:45 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Start destroying the instance on the hypervisor. {{(pid=74638) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:45 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-5e024d4d-21ee-476e-ace1-5e1dd256f8dd req-962c3cbf-5a3c-40cd-9433-e23cf6c3418f service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-unplugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5e024d4d-21ee-476e-ace1-5e1dd256f8dd req-962c3cbf-5a3c-40cd-9433-e23cf6c3418f service nova] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5e024d4d-21ee-476e-ace1-5e1dd256f8dd req-962c3cbf-5a3c-40cd-9433-e23cf6c3418f service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-5e024d4d-21ee-476e-ace1-5e1dd256f8dd req-962c3cbf-5a3c-40cd-9433-e23cf6c3418f service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-5e024d4d-21ee-476e-ace1-5e1dd256f8dd req-962c3cbf-5a3c-40cd-9433-e23cf6c3418f service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] No waiting events found dispatching network-vif-unplugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.compute.manager [req-5e024d4d-21ee-476e-ace1-5e1dd256f8dd req-962c3cbf-5a3c-40cd-9433-e23cf6c3418f service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-unplugged-42676bb9-c900-4125-9f52-5417288ef2c7 for instance with task_state deleting. {{(pid=74638) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.network.neutron [req-d7c2470f-b76e-4679-b188-a20895cbe2d9 req-12c351b8-1049-46fd-b679-f51673cdfda6 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updated VIF entry in instance network info cache for port 42676bb9-c900-4125-9f52-5417288ef2c7. {{(pid=74638) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.network.neutron [req-d7c2470f-b76e-4679-b188-a20895cbe2d9 req-12c351b8-1049-46fd-b679-f51673cdfda6 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [{"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-d7c2470f-b76e-4679-b188-a20895cbe2d9 req-12c351b8-1049-46fd-b679-f51673cdfda6 service nova] Releasing lock "refresh_cache-cecc1165-825d-46d6-be55-81b70cef33c5" {{(pid=74638) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:46 user nova-compute[74638]: INFO nova.virt.libvirt.driver [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Instance destroyed successfully.
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.objects.instance [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lazy-loading 'resources' on Instance uuid cecc1165-825d-46d6-be55-81b70cef33c5 {{(pid=74638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.vif [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T20:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-347611892',display_name='tempest-TestShelveInstance-server-347611892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-347611892',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN34gALyYu4xvSaffmTvesl2kOx1DGbQyoXHa69YrAD59nifaTPToJM5ZXK5UgzbHHMpUP8a67NGZwwQn1NCyB2shAe9J2TlCQk6cvaAkH9YvDSFDcALQZzv7Y9hoGvPRQ==',key_name='tempest-TestShelveInstance-1320692797',keypairs=<?>,launch_index=0,launched_at=2023-11-08T20:52:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc383d8a631f461fbe2920483635c17a',ramdisk_id='',reservation_id='r-nem41kkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-331524812',owner_user_name='tempest-TestShelveInstance-331524812-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T20:52:24Z,user_data=None,user_id='a47f61da50b04951ac8b351b343b8881',uuid=cecc1165-825d-46d6-be55-81b70cef33c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converting VIF {"id": "42676bb9-c900-4125-9f52-5417288ef2c7", "address": "fa:16:3e:9e:4d:eb", "network": {"id": "9ee170e6-f551-4cae-be51-63dda3f497f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1418292690-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc383d8a631f461fbe2920483635c17a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42676bb9-c9", "ovs_interfaceid": "42676bb9-c900-4125-9f52-5417288ef2c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.network.os_vif_util [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_vif [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9') {{(pid=74638) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42676bb9-c9, bridge=br-int, if_exists=True) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a9164cc-fb98-43fe-bdc8-8a102c929650) {{(pid=74638) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:53:46 user nova-compute[74638]: INFO os_vif [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:4d:eb,bridge_name='br-int',has_traffic_filtering=True,id=42676bb9-c900-4125-9f52-5417288ef2c7,network=Network(9ee170e6-f551-4cae-be51-63dda3f497f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42676bb9-c9')
Nov 08 20:53:46 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] calling os-brick to detach iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe53c609210>, {'target_iqn': 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDIkymjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 20:53:46 user nova-compute[74638]: WARNING os_brick.initiator.connectors.base [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[91387855-a13b-4dca-a7b3-a8bbe8a98ba1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 20:53:46 user nova-compute[74638]: No targets found.
Nov 08 20:53:46 user nova-compute[74638]: iSNS:
Nov 08 20:53:46 user nova-compute[74638]: No targets found.
Nov 08 20:53:46 user nova-compute[74638]: STATIC:
Nov 08 20:53:46 user nova-compute[74638]: Target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb
Nov 08 20:53:46 user nova-compute[74638]:         Portal: 172.16.0.220:3260,-1
Nov 08 20:53:46 user nova-compute[74638]:                 Iface Name: default
Nov 08 20:53:46 user nova-compute[74638]: FIRMWARE:
Nov 08 20:53:46 user nova-compute[74638]: No targets found.
Nov 08 20:53:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 20:53:46 user nova-compute[74638]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 20:53:46 user nova-compute[74638]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74638) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb', 0)] {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9970ea-0ac7-4be9-9b1b-fe95d988e052]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d26dee3-6580-4933-8146-071ba3d392a7]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:53:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb (non-flash)
Nov 08 20:53:46 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe53c354d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb'): ({'sdc'}, set())}) {{(pid=74638) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Removing single pathed devices sdc {{(pid=74638) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b6c3b8-f09c-4a45-b62a-b6b99c361e87]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abe98a3-825d-4525-868d-5d5deccc73ca]: (4, ('ok\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Flushing IO for device /dev/sdc {{(pid=74638) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[437f371a-69e8-45db-86eb-65bbd358335b]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74638) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 20:53:46 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc66dfa-8096-43a9-8f31-d239229ddc4c]: (4, ('1', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG os_brick.initiator.linuxscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] SCSI volumes sdc have been removed. {{(pid=74638) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb')] {{(pid=74638) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f15bb68-bc9e-478f-bf58-e95bfc73c94c]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --logout {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9855778-a8ab-4a17-97ef-4df1de6c57be]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260]
Nov 08 20:53:47 user nova-compute[74638]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb, portal: 172.16.0.220,3260] successful.
Nov 08 20:53:47 user nova-compute[74638]:  stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op delete {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21210e08-68ab-4ec3-aabc-7c8a72300feb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85977) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1e0f62-1864-4189-b897-73a7281a5662]: (4, ('', '')) {{(pid=85977) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74638) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.base [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG os_brick.initiator.connectors.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] <== disconnect_volume: return (303ms) None {{(pid=74638) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Disconnected iSCSI Volume {{(pid=74638) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 20:53:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Deleting instance files /opt/stack/data/nova/instances/cecc1165-825d-46d6-be55-81b70cef33c5_del
Nov 08 20:53:47 user nova-compute[74638]: INFO nova.virt.libvirt.driver [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Deletion of /opt/stack/data/nova/instances/cecc1165-825d-46d6-be55-81b70cef33c5_del complete
Nov 08 20:53:47 user nova-compute[74638]: INFO nova.compute.manager [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 08 20:53:47 user nova-compute[74638]: DEBUG oslo.service.loopingcall [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74638) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG nova.compute.manager [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Deallocating network for instance {{(pid=74638) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] deallocate_for_instance() {{(pid=74638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 20:53:47 user nova-compute[74638]: DEBUG nova.network.neutron [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Updating instance_info_cache with network_info: [] {{(pid=74638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 20:53:47 user nova-compute[74638]: INFO nova.compute.manager [-] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Took 0.43 seconds to deallocate network for instance.
Nov 08 20:53:47 user nova-compute[74638]: DEBUG nova.compute.manager [req-08402ecd-3b41-46f0-9148-6a35de507afe req-a87297fa-7faa-4881-a870-08afeda93f9b service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-deleted-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-65bd6897-82dd-4d18-a974-ce4dcae089dc req-417ff61a-fc00-450d-a8f3-c4dbb709d978 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65bd6897-82dd-4d18-a974-ce4dcae089dc req-417ff61a-fc00-450d-a8f3-c4dbb709d978 service nova] Acquiring lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65bd6897-82dd-4d18-a974-ce4dcae089dc req-417ff61a-fc00-450d-a8f3-c4dbb709d978 service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [req-65bd6897-82dd-4d18-a974-ce4dcae089dc req-417ff61a-fc00-450d-a8f3-c4dbb709d978 service nova] Lock "cecc1165-825d-46d6-be55-81b70cef33c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG nova.compute.manager [req-65bd6897-82dd-4d18-a974-ce4dcae089dc req-417ff61a-fc00-450d-a8f3-c4dbb709d978 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] No waiting events found dispatching network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 {{(pid=74638) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 20:53:48 user nova-compute[74638]: WARNING nova.compute.manager [req-65bd6897-82dd-4d18-a974-ce4dcae089dc req-417ff61a-fc00-450d-a8f3-c4dbb709d978 service nova] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Received unexpected event network-vif-plugged-42676bb9-c900-4125-9f52-5417288ef2c7 for instance with vm_state active and task_state deleting.
Nov 08 20:53:48 user nova-compute[74638]: INFO nova.compute.manager [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Took 0.89 seconds to detach 1 volumes for instance.
Nov 08 20:53:48 user nova-compute[74638]: DEBUG nova.compute.manager [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] [instance: cecc1165-825d-46d6-be55-81b70cef33c5] Deleting volume: 21210e08-68ab-4ec3-aabc-7c8a72300feb {{(pid=74638) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:53:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:48 user nova-compute[74638]: INFO nova.scheduler.client.report [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Deleted allocations for instance cecc1165-825d-46d6-be55-81b70cef33c5
Nov 08 20:53:48 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-05606223-ef53-45cd-bf6e-ca06edb36329 tempest-TestShelveInstance-331524812 tempest-TestShelveInstance-331524812-project-member] Lock "cecc1165-825d-46d6-be55-81b70cef33c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.118s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:53:49 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:53:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:54:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:54:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:14 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:17 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:30 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:54:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:37 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:37 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:38 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:39 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:54:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:54:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:54:39 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:54:39 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:54:39 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:54:39 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=9113MB free_disk=25.113269805908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:54:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:54:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:54:40 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:54:40 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:54:40 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:54:40 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:54:40 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:54:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:54:41 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:41 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:54:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:54:41 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:54:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:44 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:44 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:54:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:54:52 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:54:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:55:29 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:32 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:55:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:37 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:38 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:39 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:55:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:55:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:55:39 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:55:39 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:55:39 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:55:39 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=9184MB free_disk=25.111156463623047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:55:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:55:39 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:55:40 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:55:40 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:55:40 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:55:40 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:55:40 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:55:40 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:55:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:55:42 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:42 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:55:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:55:42 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:55:44 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:45 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:55:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:55:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:55:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:55:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:55:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:55:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:55:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:56:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:56:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:56:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:56:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:56:01 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:06 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:56:11 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:16 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:21 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:56:26 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:31 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:33 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:34 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:35 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:35 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74638) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 20:56:36 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:38 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:40 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:41 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:56:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:56:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:56:41 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Auditing locally available compute resources for user (node: user) {{(pid=74638) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 20:56:41 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:41 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:56:41 user nova-compute[74638]: WARNING nova.virt.libvirt.driver [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 20:56:41 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Hypervisor/Node resource view: name=user free_ram=9305MB free_disk=25.108619689941406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74638) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 20:56:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 20:56:41 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 20:56:42 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 20:56:42 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74638) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 20:56:42 user nova-compute[74638]: DEBUG nova.compute.provider_tree [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed in ProviderTree for provider: cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 {{(pid=74638) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 20:56:42 user nova-compute[74638]: DEBUG nova.scheduler.client.report [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Inventory has not changed for provider cf9a8087-10bd-4ed4-a234-599b2cfc0bb8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74638) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 20:56:42 user nova-compute[74638]: DEBUG nova.compute.resource_tracker [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Compute_service record updated for user:user {{(pid=74638) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 20:56:42 user nova-compute[74638]: DEBUG oslo_concurrency.lockutils [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74638) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 20:56:43 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:44 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Starting heal instance info cache {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 20:56:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Rebuilding the list of instances to heal {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 20:56:44 user nova-compute[74638]: DEBUG nova.compute.manager [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Didn't find any instances for network info cache update. {{(pid=74638) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 20:56:46 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 20:56:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74638) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 20:56:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:56:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74638) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 20:56:46 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:47 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:51 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 20:56:52 user nova-compute[74638]: DEBUG oslo_service.periodic_task [None req-73d90e94-29af-4a31-9239-1e42e510d25f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74638) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 20:56:56 user nova-compute[74638]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74638) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}